Tintable window system computing platform

ABSTRACT

Resources of a system for controlling optically switchable windows may be used for a personal computing unit. The window system resources may include (i) a display associated with an optically switchable window, (ii) one or more processors of one or more controllers on a window network connected to a plurality of optically switchable windows in a building, wherein the one or more controllers are configured to vary tint states of the plurality of optically switchable windows in the building, (iii) memory of one or more controllers on the window network connected to the plurality of optically switchable windows in the building, and/or (iv) at least a part of the window network.

CROSS-REFERENCES TO RELATED APPLICATIONS

This application claims benefit of the following US Provisional patentapplications which are hereby incorporated by reference in theirentirety and for all purposes: Application No. 62/490,457, filed Apr.26, 2017, and titled “ELECTROCHROMIC WINDOWS WITH TRANSPARENT DISPLAYTECHNOLOGY”; Application No. 62/506,514, filed May 15, 2017, and titled“ELECTROCHROMIC WINDOWS WITH TRANSPARENT DISPLAY TECHNOLOGY”;Application No. 62/507,704, filed May 17, 2017, and titled“ELECTROCHROMIC WINDOWS WITH TRANSPARENT DISPLAY TECHNOLOGY”;Application No. 62/523,606, filed Jun. 22, 2017, and titled“ELECTROCHROMIC WINDOWS WITH TRANSPARENT DISPLAY TECHNOLOGY”; andApplication No. 62/607,618, filed Dec. 19, 2017, and titled“ELECTROCHROMIC WINDOWS WITH TRANSPARENT DISPLAY TECHNOLOGY FIELD.”

BACKGROUND

Electrochromism is a phenomenon in which a material exhibits areversible electrochemically-mediated change in an optical property whenplaced in a different electronic state, typically by being subjected toa voltage change. The optical property is typically one or more ofcolor, transmittance, absorbance, and reflectance.

Electrochromic materials may be incorporated into, for example, windowsfor home, commercial and other uses as thin film coatings on the windowglass. The color, transmittance, absorbance, and/or reflectance of suchwindows may be changed by inducing a change in the electrochromicmaterial, for example, electrochromic windows are windows that can bedarkened or lightened electronically. A small voltage applied to anelectrochromic device of the window will cause them to darken; reversingthe voltage polarity causes them to lighten. This capability allowscontrol of the amount of light that passes through the windows, andpresents an opportunity for electrochromic windows to be used asenergy-saving devices.

While electrochromic devices, and particularly electrochromic windows,are finding acceptance in building designs and construction, they havenot begun to realize their full commercial potential.

SUMMARY

Certain aspects of this disclosure pertain to personal computing unitsthat may be characterized by the following elements: (a) a window systemresource; and (b) logic configured to allocate and control the windowsystem resource in the personal computing unit made available to a userin the building. In some embodiments, the window system resource is (i)a display associated with an optically switchable window, (ii) one ormore processors of one or more controllers on a window network connectedto a plurality of optically switchable windows in a building, whereinthe one or more controllers are configured to vary tint states of theplurality of optically switchable windows in the building, (iii) memoryof one or more controllers on the window network connected to theplurality of optically switchable windows in the building, or (iv) atleast a part of the window network. A personal computing unit may employcombinations of these resources. The window system resource may beconnected to other window systems resources by the window network.

In certain embodiments, the one or more controllers include at least onewindow controller. In certain embodiments, the personal computing unitadditionally includes a touch sensitive interface.

In certain embodiments, the at least two window system resourcesinclude: the display associated with an optically switchable window andthe one or more processors of the one or more controllers on the windownetwork. In such embodiments, the at least two window system resourcesmay additionally include: the memory of one or more controllers on thewindow network. Further, the at least two window system resources mayadditionally include: the at least part of the window network.

In certain embodiments, the logic is further configured to allocate andcontrol window system resources in the personal computing unit for onlya defined period of time or until an event is detected. In certainembodiments, the logic is further configured to allocate and control atleast two window system resources in the personal computing unit. Incertain embodiments, the logic is further configured to coordinate ortrigger coordinating the use of multiple physical memories or storagedevices for the personal computing unit. In certain embodiments, thelogic is further configured to coordinate or trigger coordinating theuse of multiple processors for the personal computing unit. In certainembodiments, the logic is further configured to temporarily provide anoperating system for running on the personal computing unit.

In certain embodiments, the logic is further configured to permit thepersonal computing unit to access one or more software applications. Incertain embodiments, the logic is further configured to permit thepersonal computing unit to access one or more internet sites.

Another aspect of the disclosure pertains to methods of configuringwindow system resources to provide a personal computing unit for a user.Such methods may be characterized by the following operations: (a)selecting window system resources to serve as components of the personalcomputing unit for the user; (b) allocating some or all of the windowsystem resources selected in (a) as at least a portion of the personalcomputing unit for a defined period of time; and (c) configuring thewindow system resources allocated in (b) to coordinate effort as thepersonal computing unit.

In certain embodiments, configuring the windows systems resourcesallocated in (b) includes running an instance of an operating system onthe personal computing unit. In certain embodiments, configuring thewindows systems resources allocated in (b) includes applying computersecurity based on information about the user.

In some cases, a method may additionally include identifying,authenticating, and/or authorizing the user prior to permitting the userto access the personal computing unit. In some cases, a method mayadditionally include monitoring operation of the window system resourcesconfigured in (c) during their use in the personal computing unit. Insome cases, a method may additionally include, upon detecting a definedevent, terminating use or deallocating the window system resourcesconfigured in (c).

These and other features of the disclosure will be described in moredetail below.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows a cross-sectional view of an electrochromic device coatingthat may be used in a tintable window

FIG. 2 shows a cross-sectional side view of a tintable windowconstructed as an IGU.

FIG. 3 depicts a window control network provided by of a window controlsystem having one or more tintable windows.

FIG. 4 depicts an electrochromic (EC) window lite, or IGU or laminate,with a transparent display.

FIG. 5 depicts an electrochromic insulated glass unit with an on-glasstransparent display.

FIG. 6 depicts an optically switchable window configured with aprojector for displaying an image on the surface of the opticallyswitchable window.

FIG. 7 illustrates one configuration of how the architecture of how anon-glass transparent controller can be implemented.

FIGS. 8a and 8b depict an EC IGU 802 with an IGU connector for EC,antenna, and video applications.

FIG. 9 depicts a façade of a building 900 having IGUs with variouscapabilities

FIG. 10 depicts an atmospheric gas sensor that may be located on orassociated with an IGU

FIGS. 11a-11g depict network architectures that may be used by thewindow control system.

FIGS. 12a-12c illustrate example graphical user interfaces used inconjunction with proximity and personalization services implements onoptically switchable windows.

FIG. 13 illustrates a window with a transparent display configured forasset tracking.

FIGS. 14a-14e depict windows with transparent displays used forbusiness, collaboration, video conferencing, and entertainment purposes.

FIGS. 15a-15c illustrate a window network configured to selectivelydeter unauthorized drones from flying around a building via windowtinting and wireless communication jamming.

FIGS. 16a and 16b depict windows configured to detect security and/orsafety threats.

FIG. 17 depicts an exploded view of a window configured for RFcommunication and receiving solar power.

FIGS. 18a and 18b illustrate how windows can be configured to provide orblock RF communication.

FIG. 19 provides a table showing a number of configurations where anelectrochromic window can enable RF communications and/or serve as asignal blocking device.

FIG. 20 illustrates a window that acts as Wi-Fi passive signal blockingapparatus as well as a Wi-Fi repeater.

FIG. 21 depicts a building having windows with exterior facingtransparent displays.

FIGS. 22a and 22b cellular infrastructures without and with the use ofbuildings equipped with windows for cellular communication.

FIG. 23 depicts an optically switchable window configured as a bridgebetween one or more networks exterior to a building and one or morenetworks within a building.

DETAILED DESCRIPTION

Introduction:

The following detailed description is directed to certain embodiments orimplementations for the purposes of describing the disclosed aspects.However, the teachings herein can be applied and implemented in amultitude of different ways. In the following detailed description,references are made to the accompanying drawings. Although the disclosedimplementations are described in sufficient detail to enable one skilledin the art to practice the implementations, it is to be understood thatthese examples are not limiting; other implementations may be used andchanges may be made to the disclosed implementations without departingfrom their spirit and scope. Furthermore, while the disclosedembodiments focus on electrochromic windows (also referred to asoptically switchable windows, tintable and smart windows), the conceptsdisclosed herein may apply to other types of switchable optical devicesincluding, for example, liquid crystal devices and suspended particledevices, among others. For example, a liquid crystal device or asuspended particle device, rather than an electrochromic device, couldbe incorporated into some or all of the disclosed implementations.Additionally, the conjunction “or” is intended herein in the inclusivesense where appropriate unless otherwise indicated; for example, thephrase “A, B or C” is intended to include the possibilities of “A,” “B,”“C,” “A and B,” “B and C,” “A and C” and “A, B, and C.”

Tintable Windows—

A tintable window (sometimes referred to as an optically switchablewindow) is a window that exhibits a controllable and reversible changein an optical property when a stimulus is applied, e.g., an appliedvoltage. Tintable windows can be used to control lighting conditions andthe temperature within a building by regulating the transmission ofsolar energy and thus heat load imposed on the interior of the building.The control may be manual or automatic and may be used for maintainingoccupant comfort while reducing the energy consumption of heating, airconditioning and/or lighting systems. In some cases, tintable windowsmay be responsive to environmental sensors and user control. In thisapplication, tintable windows are most frequently described withreference to electrochromic windows located between the interior and theexterior of a building or structure. However, this need not be the case.Tintable windows may operate using liquid crystal devices, suspendedparticle devices, microelectromechanical systems (MEMS) devices (such asmicroshutters), or any technology known now, or later developed, that isconfigured to control light transmission through a window. Windows withMEMS devices for tinting are further described in U.S. patentapplication Ser. No. 14/443,353, filed May 15, 2015, and titled“MULTI-PANE WINDOWS INCLUDING FT ELECTROCHROMIC DEVICES ANDELECTROMECHANICAL SYSTEMS DEVICES,” which is herein incorporated byreference in its entirety. In some cases, tintable windows can belocated within the interior of a building, e.g., between a conferenceroom and a hallway. In some cases, tintable windows can be used inautomobiles, trains, aircraft, and other vehicles in lieu of a passiveor non-tinting window.

Electrochromic (EC) device coatings—An EC device coating (sometimesreferred to as an EC device (ECD) is a coating comprising at least onelayer of electrochromic material that exhibits a change from one opticalstate to another when an electric potential is applied across the ECdevice. The transition of the electrochromic layer from one opticalstate to another optical state can be caused by reversible ion insertioninto the electrochromic material (for example, by way of intercalation)and a corresponding injection of charge-balancing electrons. In someinstances, some fraction of the ions responsible for the opticaltransition is irreversibly bound up in the electrochromic material. Inmany EC devices, some or all of the irreversibly bound ions can be usedto compensate for “blind charge” in the material. In someimplementations, suitable ions include lithium ions (Li+) and hydrogenions (H+) (i.e., protons). In some other implementations, other ions canbe suitable. Intercalation of lithium ions, for example, into tungstenoxide (WO_(3-y) (0<y≤˜0.3)) causes the tungsten oxide to change from atransparent state to a blue state. EC device coatings as describedherein are located within the viewable portion of the tintable windowsuch that the tinting of the EC device coating can be used to controlthe optical state of the tintable window.

A schematic cross-section of an electrochromic device 100 in accordancewith some embodiments is shown in FIG. 1. The EC device coating isattached to a substrate 102, a transparent conductive layer (TCL) 104,an electrochromic layer (EC) 106 (sometimes also referred to as acathodically coloring layer or a cathodically tinting layer), an ionconducting layer or region (IC) 108, a counter electrode layer (CE) 110(sometimes also referred to as an anodically coloring layer oranodically tinting layer), and a second TCL 114. Elements 104, 106, 108,110, and 114 are collectively referred to as an electrochromic stack120. A voltage source 116 operable to apply an electric potential acrossthe electrochromic stack 120 effects the transition of theelectrochromic coating from, e.g., a clear state to a tinted state. Inother embodiments, the order of layers is reversed with respect to thesubstrate. That is, the layers are in the following order: substrate,TCL, counter electrode layer, ion conducting layer, electrochromicmaterial layer, TCL.

In various embodiments, the ion conductor region 108 may form from aportion of the EC layer 106 and/or from a portion of the CE layer 110.In such embodiments, the electrochromic stack 120 may be deposited toinclude cathodically coloring electrochromic material (the EC layer) indirect physical contact with an anodically coloring counter electrodematerial (the CE layer). The ion conductor region 108 (sometimesreferred to as an interfacial region, or as an ion conductingsubstantially electronically insulating layer or region) may then formwhere the EC layer 106 and the CE layer 110 meet, for example throughheating and/or other processing steps. Electrochromic devices fabricatedwithout depositing a distinct ion conductor material are furtherdiscussed in U.S. patent application Ser. No. 13/462,725, filed May 2,2012, and titled “ELECTROCHROMIC DEVICES,” which is herein incorporatedby reference in its entirety. In some embodiments, an EC device coatingmay also include one or more additional layers such as one or morepassive layers. For example, passive layers can be used to improvecertain optical properties, to provide moisture or to provide scratchresistance. These or other passive layers also can serve to hermeticallyseal the EC stack 120. Additionally, various layers, includingtransparent conducting layers (such as 104 and 114), can be treated withanti-reflective or protective oxide or nitride layers.

In certain embodiments, the electrochromic device reversibly cyclesbetween a clear state and a tinted state. In the clear state, apotential is applied to the electrochromic stack 120 such that availableions in the stack that can cause the electrochromic material 106 to bein the tinted state reside primarily in the counter electrode 110. Whenthe potential applied to the electrochromic stack is reversed, the ionsare transported across the ion conducting layer 108 to theelectrochromic material 106 and cause the material to enter the tintedstate.

It should be understood that the reference to a transition between aclear state and tinted state is non-limiting and suggests only oneexample, among many, of an electrochromic transition that may beimplemented. Unless otherwise specified herein, whenever reference ismade to a clear-tinted transition, the corresponding device or processencompasses other optical state transitions such asnon-reflective-reflective, transparent-opaque, etc. Further, the terms“clear” and “bleached” refer to an optically neutral state, e.g.,untinted, transparent or translucent. Still further, unless specifiedotherwise herein, the “color” or “tint” of an electrochromic transitionis not limited to any particular wavelength or range of wavelengths. Asunderstood by those of skill in the art, the choice of appropriateelectrochromic and counter electrode materials governs the relevantoptical transition.

In certain embodiments, all of the materials making up electrochromicstack 120 are inorganic, solid (i.e., in the solid state), or bothinorganic and solid. Because organic materials tend to degrade overtime, particularly when exposed to heat and UV light as tinted buildingwindows are, inorganic materials offer the advantage of a reliableelectrochromic stack that can function for extended periods of time.Materials in the solid state also offer the advantage of not havingcontainment and leakage issues, as materials in the liquid state oftendo. It should be understood that any one or more of the layers in thestack may contain some amount of organic material, but in manyimplementations, one or more of the layers contain little or no organicmatter. The same can be said for liquids that may be present in one ormore layers in small amounts. It should also be understood that solidstate material may be deposited or otherwise formed by processesemploying liquid components such as certain processes employing sol-gelsor chemical vapor deposition.

FIG. 2 shows a cross-sectional view of an example tintable window takingthe form of an insulated glass unit (“IGU”) 200 in accordance with someimplementations. Generally speaking, unless stated otherwise, the terms“IGU,” “tintable window,” and “optically switchable window” are usedinterchangeably. This depicted convention is generally used, forexample, because it is common and because it can be desirable to haveIGUs serve as the fundamental constructs for holding electrochromicpanes (also referred to as “lites”) when provided for installation in abuilding. An IGU lite or pane may be a single substrate or amulti-substrate construct, such as a laminate of two substrates. IGUs,especially those having double- or triple-pane configurations, canprovide a number of advantages over single pane configurations; forexample, multi-pane configurations can provide enhanced thermalinsulation, noise insulation, environmental protection and/or durabilitywhen compared with single-pane configurations. A multi-paneconfiguration also can provide increased protection for an ECD, forexample, because the electrochromic films, as well as associated layersand conductive interconnects, can be formed on an interior surface ofthe multi-pane IGU and be protected by an inert gas fill in the interiorvolume, 208, of the IGU. The inert gas fill provides at least some ofthe (heat) insulating function of an IGU. Electrochromic IGU's haveadded heat blocking capability by virtue of a tintable coating thatabsorbs (or reflects) heat and light.

FIG. 2 more particularly shows an example implementation of an IGU 200that includes a first pane 204 having a first surface S1 and a secondsurface S2. In some implementations, the first surface S1 of the firstpane 204 faces an exterior environment, such as an outdoors or outsideenvironment. The IGU 200 also includes a second pane 206 having a firstsurface S3 and a second surface S4. In some implementations, the secondsurface S4 of the second pane 206 faces an interior environment, such asan inside environment of a home, building or vehicle, or a room orcompartment within a home, building or vehicle.

In some implementations, each of the first and the second panes 204 and206 are transparent or translucent—at least to light in the visiblespectrum. For example, each of the panes 204 and 206 can be formed of aglass material and especially an architectural glass or othershatter-resistant glass material such as, for example, a silicon oxide(SO_(x))-based glass material. As a more specific example, each of thefirst and the second panes 204 and 206 can be a soda-lime glasssubstrate or float glass substrate. Such glass substrates can becomposed of, for example, approximately 75% silica (SiO₂) as well asNa₂O, CaO, and several minor additives. However, each of the first andthe second panes 204 and 206 can be formed of any material havingsuitable optical, electrical, thermal, and mechanical properties. Forexample, other suitable substrates that can be used as one or both ofthe first and the second panes 204 and 206 can include other glassmaterials as well as plastic, semi-plastic and thermoplastic materials(for example, poly(methyl methacrylate), polystyrene, polycarbonate,allyl diglycol carbonate, SAN (styrene acrylonitrile copolymer),poly(4-methyl-1-pentene), polyester, polyamide), or mirror materials. Insome implementations, each of the first and the second panes 204 and 206can be strengthened, for example, by tempering, heating, or chemicallystrengthening.

Generally, each of the first and the second panes 204 and 206, as wellas the IGU 200 as a whole, is a rectangular solid. However, in someother implementations other shapes are possible and may be desired (forexample, circular, elliptical, triangular, curvilinear, convex orconcave shapes). In some specific implementations, a length “L” of eachof the first and the second panes 204 and 206 can be in the range ofapproximately 20 inches (in.) to approximately 10 feet (ft.), a width“W” of each of the first and the second panes 204 and 206 can be in therange of approximately 20 in. to approximately 10 ft., and a thickness“T” of each of the first and the second panes 204 and 206 can be in therange of approximately 0.3 millimeters (mm) to approximately 10 mm(although other lengths, widths or thicknesses, both smaller and larger,are possible and may be desirable based on the needs of a particularuser, manager, administrator, builder, architect or owner). In exampleswhere thickness T of substrate 204 is less than 3 mm, typically thesubstrate is laminated to an additional substrate which is thicker andthus protects the thin substrate 204. Additionally, while the IGU 200includes two panes (204 and 206), in some other implementations, an IGUcan include three or more panes. Furthermore, in some implementations,one or more of the panes can itself be a laminate structure of two,three, or more layers or sub-panes.

The first and second panes 204 and 206 are spaced apart from one anotherby a spacer 218, which is typically a frame structure, to form aninterior volume 208. In some implementations, the interior volume isfilled with Argon (Ar), although in some other implementations, theinterior volume 108 can be filled with another gas, such as anothernoble gas (for example, krypton (Kr) or xenon (Xn)), another (non-noble)gas, or a mixture of gases (for example, air). Filling the interiorvolume 208 with a gas such as Ar, Kr, or Xn can reduce conductive heattransfer through the IGU 200 because of the low thermal conductivity ofthese gases as well as improve acoustic insulation due to theirincreased atomic weights. In some other implementations, the interiorvolume 208 can be evacuated of air or other gas. Spacer 218 generallydetermines the height “C” of the interior volume 208; that is, thespacing between the first and the second panes 204 and 206. In FIG. 2,the thickness of the ECD, sealant 220/222 and bus bars 226/228 is not toscale; these components are generally very thin but are exaggerated herefor ease of illustration only. In some implementations, the spacing “C”between the first and the second panes 204 and 206 is in the range ofapproximately 6 mm to approximately 30 mm. The width “D” of spacer 218can be in the range of approximately 5 mm to approximately 25 mm(although other widths are possible and may be desirable).

Although not shown in the cross-sectional view, spacer 218 is generallya frame structure formed around all sides of the IGU 200 (for example,top, bottom, left and right sides of the IGU 200). For example, spacer218 can be formed of a foam or plastic material. However, in some otherimplementations, spacers can be formed of metal or other conductivematerial, for example, a metal tube or channel structure having at least3 sides, two sides for sealing to each of the substrates and one side tosupport and separate the lites and as a surface on which to apply asealant, 224. A first primary seal 220 adheres and hermetically sealsspacer 218 and the second surface S2 of the first pane 204. A secondprimary seal 222 adheres and hermetically seals spacer 218 and the firstsurface S3 of the second pane 206. In some implementations, each of theprimary seals 220 and 222 can be formed of an adhesive sealant such as,for example, polyisobutylene (PIB). In some implementations, IGU 200further includes secondary seal 224 that hermetically seals a borderaround the entire IGU 200 outside of spacer 218. To this end, spacer 218can be inset from the edges of the first and the second panes 204 and206 by a distance “E.” The distance “E” can be in the range ofapproximately 4 mm to approximately 8 mm (although other distances arepossible and may be desirable). In some implementations, secondary seal224 can be formed of an adhesive sealant such as, for example, apolymeric material that resists water and that adds structural supportto the assembly, such as silicone, polyurethane and similar structuralsealants that form a watertight seal.

In the implementation shown in FIG. 2, an ECD 210 is formed on thesecond surface S2 of the first pane 204. In some other implementations,ECD 210 can be formed on another suitable surface, for example, thefirst surface S1 of the first pane 204, the first surface S3 of thesecond pane 206 or the second surface S4 of the second pane 206. The ECD210 includes an electrochromic (“EC”) stack 212, which itself mayinclude one or more layers as described with reference to FIG. 1.

Window Controllers—Window controllers are associated with one or moretintable windows and are configured to control a window's optical stateby applying a stimulus to the window—e.g., by applying a voltage or acurrent to an EC device coating. Window controllers as described hereinmay have many sizes, formats, and locations with respect to theoptically switchable windows they control. Typically, the controllerwill be attached to a lite of an IGU or laminate but it can also be in aframe that houses the IGU or laminate or even in a separate location. Aspreviously mentioned, a tintable window may include one, two, three ormore individual electrochromic panes (an electrochromic device on atransparent substrate). Also, an individual pane of an electrochromicwindow may have an electrochromic coating that has independentlytintable zones. A controller as described herein can control allelectrochromic coatings associated with such windows, whether theelectrochromic coating is monolithic or zoned.

If not directly, attached to a tintable window, IGU, or frame, thewindow controller is generally located in proximity to the tintablewindow. For example, a window controller may be adjacent to the window,on the surface of one of the window's lites, within a wall next to awindow, or within a frame of a self-contained window assembly. In someembodiments, the window controller is an “in situ” controller; that is,the controller is part of a window assembly, an IGU or a laminate, andmay not have to be matched with the electrochromic window, andinstalled, in the field, e.g., the controller travels with the window aspart of the assembly from the factory. The controller may be installedin the window frame of a window assembly, or be part of an IGU orlaminate assembly, for example, mounted on or between panes of the IGUor on a pane of a laminate. In cases where a controller is located onthe visible portion of an IGU, at least a portion of the controller maybe substantially transparent. Further examples of on glass controllersare provided in U.S. patent application Ser. No. 14/951,410, filed Nov.14, 2015, and titled “SELF CONTAINED EC IGU,” which is hereinincorporated by reference in its entirety. In some embodiments, alocalized controller may be provided as more than one part, with atleast one part (e.g., including a memory component storing informationabout the associated electrochromic window) being provided as a part ofthe window assembly and at least one other part being separate andconfigured to mate with the at least one part that is part of the windowassembly, IGU or laminate. In certain embodiments, a controller may bean assembly of interconnected parts that are not in a single housing,but rather spaced apart, e.g., in the secondary seal of an IGU. In otherembodiments the controller is a compact unit, e.g., in a single housingor in two or more components that combine, e.g., a dock and housingassembly, that is proximate the glass, not in the viewable area, ormounted on the glass in the viewable area.

In one embodiment, the window controller is incorporated into or ontothe IGU and/or the window frame prior to installation of the tintablewindow, or at least in the same building as the window. In oneembodiment, the controller is incorporated into or onto the IGU and/orthe window frame prior to leaving the manufacturing facility. In oneembodiment, the controller is incorporated into the IGU, substantiallywithin the secondary seal. In another embodiment, the controller isincorporated into or onto the IGU, partially, substantially, or whollywithin a perimeter defined by the primary seal between the sealingseparator and the substrate.

Having the controller as part of an IGU and/or a window assembly, theIGU can possess logic and features of the controller that, e.g., travelswith the IGU or window unit. For example, when a controller is part ofthe IGU assembly, in the event the characteristics of the electrochromicdevice(s) change over time (e.g., through degradation), acharacterization function can be used, for example, to update controlparameters used to drive tint state transitions. In another example, ifalready installed in an electrochromic window unit, the logic andfeatures of the controller can be used to calibrate the controlparameters to match the intended installation, and for example ifalready installed, the control parameters can be recalibrated to matchthe performance characteristics of the electrochromic pane(s).

In other embodiments, a controller is not pre-associated with a window,but rather a dock component, e.g., having parts generic to anyelectrochromic window, is associated with each window at the factory.After window installation, or otherwise in the field, a second componentof the controller is combined with the dock component to complete theelectrochromic window controller assembly. The dock component mayinclude a chip which is programmed at the factory with the physicalcharacteristics and parameters of the particular window to which thedock is attached (e.g., on the surface which will face the building'sinterior after installation, sometimes referred to as surface 4 or“S4”). The second component (sometimes called a “carrier,” “casing,”“housing,” or “controller”) is mated with the dock, and when powered,the second component can read the chip and configure itself to power thewindow according to the particular characteristics and parameters storedon the chip. In this way, the shipped window need only have itsassociated parameters stored on a chip, which is integral with thewindow, while the more sophisticated circuitry and components can becombined later (e.g., shipped separately and installed by the windowmanufacturer after the glazier has installed the windows, followed bycommissioning by the window manufacturer). Various embodiments will bedescribed in more detail below. In some embodiments, the chip isincluded in a wire or wire connector attached to the window controller.Such wires with connectors are sometimes referred to as pigtails.

As discussed, an “IGU” includes two (or more) substantially transparentsubstrates, for example, two panes of glass, where at least onesubstrate includes an electrochromic device disposed thereon, and thepanes have a separator disposed between them. An IGU is typicallyhermetically sealed, having an interior region that is isolated from theambient environment. A “window assembly” may include an IGU or forexample a stand-alone laminate, and includes electrical leads forconnecting the IGUs or laminates one or more electrochromic devices to avoltage source, switches and the like, and may include a frame thatsupports the IGU or laminate. A window assembly may include a windowcontroller as described herein, and/or components of a window controller(e.g., a dock).

As used herein, the term outboard means closer to the outsideenvironment, while the term inboard means closer to the interior of abuilding. For example, in the case of an IGU having two panes, the panelocated closer to the outside environment is referred to as the outboardpane or outer pane, while the pane located closer to the inside of thebuilding is referred to as the inboard pane or inner pane. As labeled inFIG. 2, the different surfaces of the IGU may be referred to as S1, S2,S3, and S4 (assuming a two-pane IGU). S1 refers to the exterior-facingsurface of the outboard lite (i.e., the surface that can be physicallytouched by someone standing outside). S2 refers to the interior-facingsurface of the outboard lite. S3 refers to the exterior-facing surfaceof the inboard lite. S4 refers to the interior-facing surface of theinboard lite (i.e., the surface that can be physically touched bysomeone standing inside the building). In other words, the surfaces arelabeled S1-S4, starting from the outermost surface of the IGU andcounting inwards. In cases where an IGU includes three panes, this sametrend holds (with S6 being the surface that can be physically touched bysomeone standing inside the building). In certain embodiments employingtwo panes, the electrochromic device (or other optically switchabledevice) is disposed on S3.

Further examples of window controllers and their features are presentedin U.S. patent application Ser. No. 13/449,248, filed Apr. 17, 2012, andtitled “CONTROLLER FOR OPTICALLY-SWITCHABLE WINDOWS”; U.S. patentapplication Ser. No. 13/449,251, filed Apr. 17, 2012, and titled“CONTROLLER FOR OPTICALLY-SWITCHABLE WINDOWS”; U.S. patent applicationSer. No. 15/334,835, filed Oct. 26, 2016, and titled “CONTROLLERS FOROPTICALLY-SWITCHABLE DEVICES”; and International Patent Application No.PCT/US17/20805, filed Mar. 3, 2017, and titled “METHOD OF COMMISSIONINGELECTROCHROMIC WINDOWS,” each of which is herein incorporated byreference in its entirety

Window Control System—When a building is outfitted with tintablewindows, window controllers may be connected to one another and/or otherentities via a communications network sometimes referred to as a windowcontrol network or a window network. The network and the various devices(e.g., controllers and sensors) that are connected via the network(e.g., wired or wireless power transfer and/or communication) arereferred to herein as a window control system. Window control networksmay provide tint instructions to window controllers, provide windowinformation to master controllers or other network entities, and thelike. Examples of window information include current tint state or otherinformation collected by window controller. In some cases, a windowcontroller has one or more associated sensors including, for example, aphotosensor, a temperature sensor, an occupancy sensor, and/or gassensors that provide sensed information over the network. In some cases,information transmitted over a window communication network need notimpact window control. For example, information received at a firstwindow configured to receive a WiFi or LiFi signal may be transmittedover the communication network to a second window configured towirelessly broadcast the information as, e.g., a WiFi or LiFi signal. Awindow control network need not be limited to providing information forcontrolling tintable windows, but may also be able to communicateinformation for other devices interfacing with the communicationsnetwork such as HVAC systems, lighting systems, security systems,personal computing devices, and the like.

FIG. 3 provides an example of a control network 301 of a window controlsystem 300. The network may distribute both control instructions andfeedback, as well as serving as a power distribution network. A mastercontroller 302 communicates and functions in conjunction with multiplenetwork controllers 304, each of which network controllers is capable ofaddressing a plurality of window controllers 306 (sometimes referred toherein as leaf controllers) that apply a voltage or current to controlthe tint state of one or more optically switchable windows 308.Communication controllers (304, 306, and 308) may occur via wired (e.g.,Ethernet) or via a wireless (e.g., WiFi or LiFi) connection. In someimplementations, the master controller issues the high-levelinstructions (such as the final tint states of the electrochromicwindows) to the network controllers, and the network controllers thencommunicate the instructions to the corresponding window controllers.Typically a master controller is configured to communicate with one ormore outward face networks 309. Window control network 301 can includeany suitable number of distributed controllers having variouscapabilities or functions and need not be arranged in the hierarchicalstructure depicted in FIG. 3. As discussed elsewhere herein, network 301may also be used as a communication network between distributedcontrollers (e.g., 302, 304, 306) that act as communication nodes toother devices or systems (e.g., 309).

In some embodiments, outward facing network 309 is part of or connectedto a building management system (BMS). A BMS is a computer-based controlsystem that can be installed in a building to monitor and control thebuilding's mechanical and electrical equipment. A BMS may be configuredto control the operation of HVAC systems, lighting systems, powersystems, elevators, fire systems, security systems, and other safetysystems. BMSs are frequently used in large buildings where they functionto control the environment within the building. For example, a BMS maymonitor and control the lighting, temperature, carbon dioxide levels,and humidity within the building. In doing so, a BMS may control theoperation of furnaces, air conditioners, blowers, vents, gas lines,water lines, and the like. To control a building's environment, the BMSmay turn on and off these various devices according to rules establishedby, for example, a building administrator. One function of a BMS is tomaintain a comfortable environment for the occupants of a building. Insome implementations, a BMS can be configured not only to monitor andcontrol building conditions, but also to optimize the synergy betweenvarious systems—for example, to conserve energy and lower buildingoperation costs. In some implementations, a BMS can be configured with adisaster response. For example, a BMS may initiate the use of backupgenerators and turn off water lines and gas lines. In some cases, a BMShas a more focused application—e.g., simply controlling the HVACsystem—while parallel systems such as lighting, tintable window, and/orsecurity systems stand alone or interact with the BMS.

In some embodiments, network 309 is a remote network. For example,network 309 may operate in the cloud or on a device remote from thebuilding having the optically switchable windows. In some embodiments,network 309 is a network that provides information or allows control ofoptically switchable windows via a remote wireless device. In somecases, network 309 includes seismic event detection logic. Furtherexamples of window control systems and their features are presented inU.S. patent application Ser. No. 15/334,832, filed Oct. 26, 2016, andtitled “CONTROLLERS FOR OPTICALLY-SWITCHABLE DEVICES” and InternationalPatent Application No. PCT/US17/62634, filed on Nov. 23, 2016, andtitled “AUTOMATED COMMISSIONING OF CONTROLLERS IN A WINDOW NETWORK,”both of which are herein incorporated by reference in its entirety.

Electrochromic Windows with Transparent Display Technology:

Applicant has previously developed IGUs with integrated photovoltaics,onboard storage, integrated antennas, integrated sensors, an API toserve up valuable data, etc. It has been found that electrochromicwindows can be further improved in surprising ways, e.g., by combiningwith transparent display technology as well as augmenting sensor,onboard antenna, and software applications.

One embodiment, depicted in FIG. 4, includes an electrochromic (EC)window lite, or IGU or laminate, combined with a transparent display.The transparent display area may be co-extensive with the EC windowviewable area. An electrochromic lite, 410, including a transparent panewith an electrochromic device coating thereon and bus bars for applyingdriving voltage for tinting and bleaching, is combined with atransparent display panel, 420, in a tandem fashion. In this example,410 and 420 are combined using a sealing spacer, 430, to form an IGU,400. The transparent display may be a standalone lite for the IGU, or bee.g. a flexible panel laminated or otherwise attached to a glass lite,and that combination is the other lite of the IGU. In typicalembodiments, the transparent display is the, or is on the, inboard liteof the IGU, for use by the building occupants. In other embodiments, anelectrochromic device coating and transparent display mechanism arecombined on a single substrate. In other embodiments, a laminate, ratherthan an IGU, are formed from 410 and 420, without a sealing spacer.

The transparent display can be used for many purposes. For example, thedisplay can be used for conventional display or projection screenpurposes, such as displaying video, presentations, digital media,teleconferencing, web-based meetings including video, security warningsto occupants and/or people outside the building (e.g., emergencyresponse personnel) and the like. The transparent display can also beused for displaying controls for the display, the electrochromic window,an electrochromic window control system, an inventory management system,a security system, a building management system, and the like. Incertain embodiments, the transparent display can be used as a physicalalarm element. That is, the electrochromic lite of an IGU can be used asa breakage detector to indicate a security breach of the building'sperimeter. The transparent display could also, alone or in combinationwith the electrochromic lite, serve this function. In one example, theelectrochromic lite is used as a breakage detection sensor, i.e.,breaking the EC pane triggers an alarm. The transparent display may alsoserve this function, and/or be used as a visual alarm indicator, e.g.,displaying information to occupants and/or external emergency personnel.For example, in certain implementations, a transparent display may havea faster electrical response than the electrochromic lite, and thuscould be used to indicate alarm status, for example, externally tofirefighters, etc. or internally to occupants, e.g., to indicate thenature of the threat and/or escape routes. In one embodiment, breakageof the outboard electrochromic lite sends a signal to the transparentdisplay, via the window controller, such that the transparent displayconveys a security breach. In one embodiment, the transparent displayflashes a warning message and/or flashes red, e.g., the entiretransparent display pane may flash brightly in red to indicate troubleand be easily seen, e.g., a large window flashing in this manner wouldbe easily noticeable to occupants and/or outside personnel. In anotherexample, one or more neighboring windows may indicate damage to awindow. For example, in a curtain wall where a first window has fouradjacent windows, breakage to the first window triggers one or more ofthe four adjacent windows to flash red or display large arrows pointingto the first window, to make it easier for occupants or externalpersonnel to know where the trouble is. In a large skyscraper, with manywindows, it would be very easy for first responders to see four windowsadjacent a central window flashing, i.e., forming a flashing cross toindicate where the trouble is located. If more than one window isbroken, this method would allow instant visual confirmation of where thetrouble lies. In certain embodiments, one or more transparent displaysmay be used to display a message to first responders, indicating boththe location and nature of the emergency. It may be breakage of one ormore windows or indicate, e.g., hotspots within the building forfirefighters.

The electrochromic window can be used as a contrast element to aidvisualization of the transparent display, e.g., by tinting the EC panethe transparent display will have higher contrast. In turn, thetransparent display can be used to augment the color, hue, % T,switching speed, etc. of the electrochromic device. There are many novelsymbiotic relationships that can be exploited by the combination of ECwindow and transparent display technology. When the EC pane and thetransparent display are both in their clear state, IGU 400 appears andfunctions as a conventional window. Transparent display 420 may havesome visually discernable conductive grid pattern but otherwise istransparent, and can be uni- or bidirectional in the display function.One of ordinary skill in the art would appreciate that as transparentdisplay technology advances, the clarity and transparency of suchdevices will improve. Improvements in micro and nanostructuredaddressable grids, as well as transparent conductor technology, allowfor transparent displays where there is no visually discernableconductive grid.

FIG. 5 depicts an electrochromic insulated glass unit, 550, with anon-glass transparent display, 575, used as a control interface for IGU550. Display 575 may be wired to an onboard controller which is, e.g.,housed in the secondary sealing volume of the IGU. The wiring for thetransparent display 575 may pass through the glass, around the edge ofthe glass, or may be wirelessly connected to the onboard (or offboard)controller (not shown). When the transparent display 575 is not in use,it is essentially transparent and colorless, so as not to detract fromthe aesthetics of the IGU's viewable area. Transparent display 575 maybe adhesively attached to the glass of the IGU. Wiring to the controlunit of the window may pass around or through the glass upon which thedisplay is attached. The display may communicate with a windowcontroller or control system wirelessly via one or more antenna, whichmay also be transparent.

A transparent display may be located within the viewable area of anoptically switchable window. The transparent display may be configuredto provide various types of information about windows or the buildingvia, e.g., a graphical user interface. The display may also be used toconvey information to the user, e.g., teleconferencing, weather data,financial reports, live streaming data, asset tracking and the like asdescribed herein. In certain embodiments, the transparent display (andassociated controller) is configured to show specific information aboutthe window being used (the one displaying the information), informationabout a zone in which the window resides, and/or information about otherparticular windows in the building. Depending on user permissions, suchinformation could include information in all windows of a building oreven multiple buildings. The transparent displays (and associatedcontroller) may be configured to allow monitoring and/or controllingoptically switchable windows on a window network.

In certain embodiments, the graphical user interface may representwindows and/or other controllable systems and devices using smartobjects. A “smart object,” as described herein, is a representation ofone or more material items that can be manipulated by a user (e.g., bycontact with a touch-sensitive display) to gather and/or presentinformation about the one or more physical devices the smart objectrepresents. In some cases, a graphical user interface may display athree-dimensional building model with one or more smart objects thereon.By displaying smart objects on the building model according to theirphysical location, a user in may easily identify a smart object thatrepresents a window of interest. Smart objects allow a user to receiveinformation from, or control an aspect of, the window network and/or asystem or electronic device in communication with the window network.For example, if a user has selected a smart object representing awindow, information may be displayed such as a window ID, window type,window size, manufacturing date, current tint state, leakage current,usage history, inside temperature, outside temperature, and the like.Additionally, smart objects may present a user with options forcontrolling a window tint state, configuring a tint schedule, or tintingrules. In some cases, a window may have inboard lite with touch andgesture sensors that allow a user to interact with smart objects in thegraphical user interface. In some cases, a user may interact with thesmart objects displayed on the graphical user interface using a remotedevice that is configured to receive user input (e.g., a cell phone, acontroller, a keyboard, and the like).

In one example, during the initial installation of a plurality ofelectrochromic windows, at least one window is installed withtransparent display technology. This window may also be configured withpower, internet connectivity, and at least one processor (e.g., a windowcontroller, network controller, and/or master controller for the windowinstallation). The at least one window, by virtue of its transparentdisplay functionality, can serve as a GUI for further installation ofthe plurality of windows in the system to be installed. As the windowsof the system are installed, this use may be translated to other windowsof the system, and, additionally be used to commission windows of thesystem. This obviates the need for an installer to have a portable orother separate computing device for commissioning the windows; thewindow itself and its corresponding processing power can be used duringinstallation to aid further installation and commissioning of the windowsystem. Using, e.g., this at least one window with display technologytradespeople, engineers, and/or construction crews tasked withinstalling electrical wiring, plumbing, HVAC and other infrastructuremay have the ability to pull up building drawings on large formatdisplays, rather than carrying large paper drawings. Moreover, web-basedvideo conferencing e.g., allows workers in disparate areas of thebuilding to communicate with each other and discuss building plansdisplayed on their screens, manipulate the plans interactively via thetouchscreen function of transparent displays described herein.

In certain embodiments, rather than a transparent display registeredwith an EC device, e.g., in an IGU form factor, an interactive projectoris used to both display information onto an EC window and also allow theuser to access and input information using the interactive displaytechnology portion of the assembly. FIG. 6 depicts an example of anoptically switchable window 600 configured with a projector 606 thatdisplays an image 614 on the surface of the optically switchable window.To improve the visibility of a projected image 614, a window may beconfigured with a pixelated or monolithic passive coating that issubstantially transparent to an observer, but aids in the reflection ofthe image provided by the projector. In some cases, the level of tintingmay be adjusted to improve the visibility of a projected image. In thisregard, to ensure that the window tint state is appropriate forprojecting, the window controller 604 and projector/display controller606 may be coupled or in communication. The projector may be located ina mullion 602 (as depicted), a transom, or at a remote location such asa nearby ceiling or a wall. The projector 606 may receive information todisplay from a window controller 604, which may also be located in amullion or a transom. In some cases, a projector in a mullion, transom,or similar location is used to project an image through free space andonto a glass surface or a passive coating of the IGU. In some cases, aprojector is located within the mullion and projects light onto thedisplay via a light guide that is embedded in, formed by, or attached toa glass substrate of a display lite. The projector may in someembodiments be configured so that the end user does not see theprojector mechanism, i.e. it is hidden from view. Light may be projectedfrom the edge of the glass into the light guide, e.g., by using a mirroror by orienting the projector. In this configuration, the projector canbe concealed from view so as not to create a visual distraction. In somecases, a light guide plate is used which runs parallel to a lite whichhas a monolithic passive coating for displaying an image. Examples oflight guide plates used for a user wearable display device which can beadapted for use for transparent displays on optically switchable windowsare found in U.S. Pat. No. 9,791,701B2 titled “Display device,” andfiled on Oct. 17, 2017, which is incorporated in its entirety.

To receive user input corresponding to user motion, the window depictedFIG. 6 may be equipped with motion sensors 608 located on or withinmullions and/or transoms. The motion sensors may include one or morecameras to detect user motion (e.g., the motion of a user's hand) andimage analysis logic may determine a user's interaction with a displayedsmart object based on the detected motion. For example, image analysislogic may determine whether a user's motion corresponds to a gestureused to provide a specific input. In some cases, one or more cameras maybe inferred cameras. In some cases, the motion sensors may includeultrasonic transducers and ultrasonic sensors to determine user motion.In some cases, a window may be equipped with a capacitive touch sensor(e.g., on S1 or S4) that at least partially covers the visible portionof the window and receives user input when a user touches the surface ofthe window. For example, a capacitive touch sensor may be similar tothat found in touchscreens such as the Apple iPad. In addition to motionsensors, an optically switchable window may also be equipped with amicrophone 612 located in a mullion or transom for receiving audibleuser input. In some cases, a microphone 612 may be located on a remotedevice and voice recognition logic may be used to determine user inputfrom received audio. In some cases, audio is recorded on a remote deviceand transmitted wirelessly to a window controller. Examples of systemsthat provide a voice-controlled interface for controlling opticallyswitchable windows are provided in PCT Patent ApplicationPCT/US17/29476, filed on Apr. 25, 2017, which is herein incorporated byreference in its entirety. When a window may be configured to receiveaudible user input, a window may also be configured with one or morespeakers 610 for providing information to a user. For example, a speaker610 may be used respond to a user inquiry or to provide various featuresthat may be controlled by the user. In some cases, a projector such asan Xperia Touch™, manufactured by Sony Corporation, is attached to ornear the IGU, e.g., in a mullion or on a wall or ceiling nearby, inorder to project onto an IGU to display information to the user andprovide an on-glass control function.

In one embodiment, the window assembly includes a motion sensor, acamera, a transparent capacitive touchscreen, and/or a microphone forvoice activation. When a user interacts with the window, the projector(or transparent display) activates to show a control GUI for controllingthe window, other windows in the building, and/or other buildingsystems. The user interaction may be, e.g., movement detected near thewindow, video or image identification of the user, an appropriate touchcommand, and/or an appropriate voice command. The user can then carryout desired work, programming, data retrieval and the like. After aperiod, or by the appropriate command input provided by the user, thecontrol GUI on the glass (projected or transparent display) disappearsor ceases, leaving the (entire) unobstructed view of the window.

In certain embodiments, a window may use an electrowetting transparentdisplay technology. An electrowetting display is a pixelated displaywhere each pixel has one or more cells. Each cell can oscillate betweensubstantially transparent and substantially opaque optical states. Cellsmake use of surface tensions and electrostatic forces to control themovement of a hydrophobic solution and a hydrophilic solution within thecell. Cells can be, e.g., white, black, cyan, magenta, yellow, red,green, blue, or some other color in their opaque state (determined byeither the hydrophobic solution or the hydrophilic solution within thecell). A colored pixel may have, e.g., a cyan, magenta, yellow cells ina stacked arrangement. Perceived colors can are generated by oscillatingthe cells of a pixel (each cell having a different color) at specificfrequencies. Such displays may have many thousands or millions ofindividually addressable cells which can produce high-resolution images.

The display may be permanently or reversibly attached to theelectrochromic window. The electrochromic window may include anelectrochromic lite, an electrochromic IGU, and/or a laminate includingan electrochromic lite, for instance. In some cases, it may beadvantageous to include a reversible and/or accessible connectionbetween the display and the window such that the display can be upgradedor replaced, as needed. A display lite can be either inboard or outboardof the electrochromic device. It is noted that any of the embodimentsherein can be modified to switch the relative positions of the displaylite and the electrochromic EC device. Moreover, while certain figuresshow an electrochromic window that includes a particular number oflites, any of these embodiments can be modified such that theelectrochromic window includes any number of lites (e.g., an EC IGU maybe replaced with an EC lite or EC laminate, and vice versa).

Example solid-state electrochromic devices, methods, and apparatus formaking them and methods of making electrochromic windows with suchdevices are described in U.S. patent application Ser. No. 12/645,111,entitled “Fabrication of Low Defectivity Electrochromic Devices,” byKozlowski et al., and U.S. patent application Ser. No. 12/645,159,entitled “Electrochromic Devices,” by Wang et al., both of which areincorporated by reference herein in their entireties. In variousembodiments, a solid-state electrochromic device is used in conjunctionwith a transparent display, which may be pixelated and which may includeone or more organic or non-solid components. Examples of such displaysinclude OLEDs, electrophoretic displays, LCDs, and electrowettingdisplays. As described, the display may be fully or partiallycoextensive with an electrochromic device on a lite. Further, thedisplay may be provided in direct on contact with an electrochromicdevice, on the same lite as the electrochromic device but on a differentsurface, or on a different lite of an IGU. In some embodiments, thedisplay lite may reversibly and accessibly attach to a dock that securesthe display lite. The dock may be configured to safely receive thedisplay lite and support it at one or more edges. Examples of docks andother framing are described in U.S. patent application Ser. No.14/951,410, titled “SELF-CONTAINED EC IGU” and filed on Nov. 24, 2015,which is herein incorporated in its entirety.

In various examples, a framing system that secures a display liteincludes a structure for securing the display lite proximate an ECwindow, and wiring for providing power to the display lite. The framingsystem may further include wiring for providing communication to thedisplay lite, wiring for providing power to an EC window and/or windowcontroller, and wiring for providing communication to the EC windowand/or window controller. In these or other embodiments, the framingsystem may include wireless transmitters and/or receivers fortransmitting and/or receiving wireless control information that may becommunicated to the display lite and/or the electrochromic window/windowcontroller. The framing system may also include a number of othercomponents useful for an electrochromic window such as various sensors,cameras, etc.

In some embodiments, a framing system supporting a display lite isconfigured to be installed proximate existing framing that alreadysecures an electrochromic window. The electrochromic window isessentially being retrofitted to include the display lite in thisexample. In some such cases, the framing may include control hardware tointerface with the existing EC window. Such control hardware may usewireless communication to control the EC window in some cases.

Generally speaking, the framing system/dock/similar hardware may bereferred to as an apparatus for mounting an electronic device onto anoptically switchable window. The electronic device is a display in manycases (e.g., a display lite or other display), and may or may not betransparent. The electronic device may also be any number of otherdevices, including but not limited to a window controller, user inputdevice, etc. In some cases, the apparatus may mount more than oneelectronic device onto the optically switchable window.

In some cases, the display and the EC window may be controlled in tandemto enhance user experience. For instance, the display may be controlledin a way that takes into account the optical state of the EC window.Similarly, the optical state of the EC window may be controlled in a waythat takes into account the state of the display. In one example, the ECwindow and display may be controlled together in order to optimize theappearance of the display (e.g., such that the display is easy to see,bright, readable, etc.). In some cases, the display is easiest to seewhen the EC window is in a darkened tint state. As such, in some cases,the EC window and display may be controlled together such that the ECwindow goes to a relatively dark tint state when the display is used, orwhen the display is used and certain conditions are met (e.g., withrespect to timing, weather, light conditions, etc.).

In some embodiments, a first controller may be used to control theoptical state of the EC window, and a second controller may be used tocontrol the display. In another embodiment, a single controller may beused to control both the optical state of the EC window and the display.The logic/hardware for such control may be provided in a singlecontroller or multiple controllers, as desired for a particularapplication.

FIG. 7 illustrates one configuration of how the architecture of how anon-glass transparent controller can be implemented. The on-glasscontroller transparent display 702 is used to display controlapplications in a graphical user interface (GUI) format. The transparentdisplay is in communication with the window controller 704, eitheronboard or offboard as depicted below. A node controller 706 is used fordisplay monitoring and function. The node controller communicates with amaster controller 708 for controlling the EC functions, etc., which inturn communicates via the cloud with APIs. The window controller mayinclude RF radio, temperature sensors and control and Bluetoothcapability. Transparent on-glass controller displays can be, e.g., ascommercially available Lumineq® transparent displays from Beneq Oy, ofFinland, as described on their commercial website(http://beneq.com/en/displays/products/custom). When a window controlleris connected to a local area network (e.g., a local network provided viawindows) or connected to the internet, the transparent display and otherglass functions can be controlled in some cases, through a web-basedapplication or another application configured to communicate with thewindow control network. Such applications can be run on, e.g., phones,tablets, or desktop computers.

Applicant's previously described window control technology architecturecan, in some cases, include a daughter card containing I/O for driving atransparent display (whether on-glass controller and/or if a full windowsize display/controller). Embodiments may also include an onboardantenna. The antenna may be an on-glass antenna, e.g., fractal and/orantenna suites scribed into a transparent conductive oxide layer on alite of an IGU. Antennas are used for various functions, including RFtransmission/reception. Various EMI blocking coatings may also beincluded in embodiments.

FIGS. 8a and 8b depict an EC IGU 802 with an IGU connector 804 for EC,antenna, and video applications. An IGU connector may include a singlecable that supports each of these applications, or in some cases (suchas depicted in FIGS. 8a and 8b ) an IGU connector may include more thanone connector, each connector being used to support a differentapplication of the EC IGU. For example, a 5-pin connector 810 may beused to support EC functionality while a coax cable 808 may supportwireless communications (e.g., via window antennas) and an MHL connector808 (or I2C) may provide a video signal for the transparent display.Some embodiments include wireless power and control, which may, in somecases, obviate the need for one or more wired connectors.

Certain embodiments described herein combine the strength of an existingbuilding operating system (BOS) infrastructure with antennas and displaytechnology for additional functionality. One example of suchfunctionality is providing power for window system components such aswindow controllers, radio, and display drivers. In some cases availablepower is provided at about 2-3 W per IGU. In some implementations, ECcontrol communication can be delivered over, e.g., standard 5 wire cablewith CANbus and power. For example, a CANBus may be operated at 100 kbpsor higher, e.g., up to about 1 Mbps if needed. In some embodiments, anARCnet network is employed, operating at up to about, e.g., 2.5 Mbps. Itmay do this in various network topologies including a linear controlnetwork. Delivering content for wireless and video requires relativelyhigh bandwidth communication interfaces, which can be made availablewith window systems that employ wireless transmission, UWB, or the like,each of which can be provide 500 Mbps or higher data rates. Often windowsystem installations have many windows, thereby allowing high datarates, particularly compared to sparse systems with an occasionaltransceiver as with current Wi-Fi technology.

The aspect of adding a display device to an EC window drives a need forgreater communication bandwidth, at least if the display content changesfrequently. Bandwidth requirements may be branched into two differentproducts, one for real-time display (e.g., a projector screenreplacement) with higher bandwidth, and one for lower bandwidthapplications (e.g., signage applications).

Frequently changing content like h.264 video conferencing requires 10Mbps (Ethernet) data rates for HD quality at 30 frames a second. Morestatic data, like a static advertisement can use the existing data path(CANbus) and available bandwidth (around what's required for glasscontrol) to load the content. The content can be cached, so data couldtrickle in over an hour, and then the display updates when the frame iscomplete. Other more slowly changing data like weather feeds, or salesmetrics also don't require high-speed data. Table 1 illustrates datacommunication bandwidths and associated applications.

TABLE 1 Data communication Bandwidths. Frames Video Audio Per Videoh.263 Quality Resolution Bitrate Bitrate second codec Profile Low 480 ×270 400 kbps 64 kbps 15/30 h.264 Baseline Med 640 × 360 800-1200 kbps 96kbps 30 h.264 Main High 960 × 540 800-1500 kbps 96 kbps 30 h.264 Main HD720 1280 × 720  1,200-4,000 kbps 128 kbps 30 h.264 Main HD 1080 1920 ×1080 4,000-8,000 kbps 192 kbps  30* h.264 Main or High

For signage applications, a transparent display integrated with an ECIGU offers a number of benefits. In some cases, windows may display a“follow me” guidance system to get you to your connecting flight in themost efficient way. This guidance system may be combined with a highaccuracy location awareness system that provides personalized serviceson a display based on the location of a traveler's mobile phone and thetraveler's boarding pass for the next flight. For example, thetransparent display may indicate: “this way to your next flight, Chuck”on panes of glass as you move along the corridor in the terminal. Inanother example, personalized displays on glass doors in a grocery storemay display what is on special within a buyers preference category. Inan emergency, the display windows may indicate safe exit routes, wherefire extinguishing equipment resides, provide emergency lighting, andthe like.

For real-time displays utilizing higher bandwidth data communication,the following examples are provided. In some cases, a video projectorcan be replaced with an OLED display and an EC IGU. The EC IGU can thendarken the room and/or provide the dark background necessary for goodcontrast on the display. In another example, windows with transparentdisplays can replace TVs in commercial and residential applications. Inanother example, a window having a real-time display can providereal-time health statistics for a patient as one looks through theoutside window. In this example, the patient retains the health benefitsof natural lighting while a doctor reviews patient's chart. In yetanother example, a real-time display can be used outside of a conferenceroom wall to, e.g., display scenery to people passing by as a privacyenhancement mechanism. Privacy provided by the display can augment theprivacy provided EC glass may darken over a period. In yet anotherexample, transparent displays can provide augmented heads-up displays incars or other forms of transportation.

OLED displays or similar (TFT, etc.) components of the EC IGU may haveother applications besides providing dynamic graphical content. Forexample, OLED displays can provide general illumination. A dark windowon a winter night simply looks black or reflects the interior light, butby using an OLED display, the surface can match the color of your wall.In some cases, the transparent display can display a scene that ispleasant to a building occupant and provides privacy. For example, awindow can display a screenshot of a sunny day from that exact windowfrom a camera integrated into the on glass or onboard window controller.In another scenario, a transparent display can be used to modify theperceived color of light transmitted through the EC lite portion of theIGU. For example, a transparent display may add a tinge of blue to aclear EC IGU, or a little color to a tinted IGU to make it more gray orneutral in tint. Light provided by the display can alter the color andspectrum of the incoming daylight into the room and consequentially thecomfort, visual perception, mood, and well-being of the occupant. Insome cases, the window control system and be configured to illuminatethe room and/or control other light sources (e.g., LED lighting) in aroom to alter the color or spectrum of light observed by an occupant.For example, a tintable window may, in some configurations, impart anunwanted blue hue to the occupant's space. In such cases, light emittedfrom a transparent display and/or another light source can be used toemit specific wavelengths of light to offset the blueness or anotherunwanted hue in the occupant's space due to the transmitted light fromtintable windows. In certain embodiments, control of tintable windowsincludes control over LED lighting and/or lighting provided by atransparent display to correct this perceived and rendered color toproduce an ambient lighting condition that the occupant would prefer.Some techniques using lighting provided by a transparent display and/orother light sources can change the CCT (correlated color temperature)and CRI (color rendering index) of the light in a room to have incominglight-color closer to natural light. Further methods of using interiorlighting to improve the perceived color and spectrum light within abuilding are described in U.S. patent application Ser. No. 15/762,077,filed Mar. 21, 2018, and titled “METHODS OF CONTROLLING MULTI-ZONETINTABLE WINDOWS,” which is herein incorporated by reference in itsentirety.

In another scenario, a transparent display can also be used to changethe reflected color of light on the walls of the occupant's interiorspace. For example, instead of looking at various hues of blue on awhite wall, the display can be tuned to make that color more uniformusing feedback from an inward facing camera of an onboard windowcontroller.

In certain embodiments, the transparent display component of the IGU isused to augment or replace conventional lighting in interior spaces (orexterior spaces if the display is bi-directional). For example, OLEDdisplays can be quite bright, and therefore can be used to light up aroom (at least to some degree) as an occupant walks into the space atnight (with occupancy sensing). In another embodiment, the transparentdisplay component is used to provide a color controlled light for an artgallery at a museum, e.g., a length of EC glass on one side of a wallused to illuminate artwork on the opposite wall.

A curtain wall of IGUs may all have transparent display technology ormay be a mixture of IGUs, some with and some without transparent displaytechnology. FIG. 9 depicts a façade of a building 900 having IGUs withvarious capabilities. IGUs labeled 902, 904 and 906 are for EMIblocking. IGUs labeled 904 and 910 are configured to provide cellularcommunications to the outside world, and IGUs labeled 906 and 910 areconfigured to offer WiFi and/or cellular services to occupants withinthe building. IGUs labeled 908 only are configured for EC tinting and donot block wireless communications.

In the example depicted in FIG. 9, the top floor tenant either wants tobe isolated from the outside world or will provide their owncommunications (a cable modem for example). The building owner may,e.g., lease the outward facing antennas (904) to the local cellularcompany as repeater towers. The fourth-floor tenant may want cellularservices in the building and control when they are available. The inwardfacing antenna (906) emanate signals into the building on demand, butblocks exterior signals. The source of the signals may be the twooutward facing cellular antennas (904). The third-floor tenant wants toblock all outside signals, but offer WiFi and cellular services tooccupants (906). The second-floor tenant wants complete isolation, theymay have their own hardline (e.g., cable modem) connections, butotherwise are isolated. The ground floor is a lobby, EC glass (908)allows exterior signals to pass through the glass, as well as offering acellular repeater (910) to boost the available signals in the commonarea of the building.

Environmental Sensors:

In some embodiments, an IGU may be equipped with environmental sensorsfor air quality monitoring. For example, an IGU may have one or moreelectrochemical gas sensors that transduce a gas concentration into acurrent flow through oxidation and reduction reactions between thesensor and the sensed gas. In some embodiments, metal oxide gas sensorsmay be used. Metal oxide sensors monitor a sensed gas concentration asfunction of electronic conductivity at the sensor. In some cases, an IGUmay be able to sense one or more of the six criteria pollutants (carbonmonoxide, lead, ground-level ozone, particulate matter, nitrogendioxide, and sulfur dioxide) that are monitored by the US nationalambient air quality standards (NAAQS). In some cases, IGUs may beequipped with sensors for detecting less common pollutants if there is aspecific safety concern at an installation site. For example, in afacility for semiconductor processing, sensors may be used to monitorfor fluorocarbons or to detect chlorine gas. In some cases, a sensor maydetect carbon dioxide levels as a form of occupancy sensor, e.g., to aidwindow control logic to determine heating and cooling needs of theinterior environment.

FIG. 10 depicts a cross-sectional view of an example atmospheric gassensor that may be located on an IGU. The environmental sensor 1000includes one or more first sensing units 1002 and one or more secondsensing 1004 units disposed on a substrate 1008. A cover 1018 may bedisposed over the first and second sensing units to protect sensingunits from large particles. Vias 1016 in the cover allow chemicalparticles 1030 to pass and be detected by the sensing units. The firstsensing unit 1002 senses chemical particles when particles pass throughthe vias 1016 and adhere to the first sensor electrode 1010, changingthe electrode's resistance. The second sensing unit 1012 has aninsulating layer 1022 between the second sensor electrode 1012 and thecover 1018 and senses a capacitance change when chemical particles passthrough the vias and adhere to the insulating layer 1022. In someembodiments, the environmental sensor is also integrated with acapacitive touch sensor 1006, where the insulating layer 1024 betweenthe touch sensor electrode 1014 may be the same material as theinsulating material used for the second electrode 1022. In some cases,insulating layers used for a capacitive touch sensor and a second sensorunit 1022 and 1024 are deposited during the same operation. Inembodiments where a touch sensor is integrated with an environmentalsensor, an insulating sidewall 1020 is used to prevent the chemicalparticles from diffusing into the region near the touch sensor electrode1014. Electrodes for the first and second sensing units may be made frommaterials such as Graphene, Carbon Nano Tube (CNT), Silver Nano Wire(AgNW), Indium Tin Oxide (ITO), etc. In some cases, the same materialused for a transparent conductive layer in an electrochromic device canbe used as for an electrode of the sensing unit or the touch sensor.

In some embodiments, an environmental sensor may be located on aninterior surface or an exterior surface of an IGU. The sensor units maybe very small such that even if they are made with opaque materials theycan still be inconspicuous. For example, the area of the first sensorelectrodes and/or the second sensor electrodes may be between about 1 μmand about 10 μm, or in some cases between about 10 μm and about 100 μm.In some cases, the substrate of an environmental sensor may be locatedon or embedded in a lite of an IGU. In some embodiments, the sensor isfabricated directly on top of an electrochromic device, and in somecases, an environmental sensor may be integrated into a transparentdisplay (e.g., an OLED display) as described herein where capacitivetouch sensors provide a means accepting for user input of a GUI providedby the transparent display. In some embodiments, an environmental sensormay be fabricated separately from an IGU and then may be bonded orattached to the interior surface, the exterior surface, or the frame ofan IGU. The sensor may be part of the window controller architecture;e.g., a window controller may be part of the window assembly. In somecases, sensors are located on or associated with on glass controllerswhich are described in U.S. patent application Ser. No. 14/951,410,titled “SELF-CONTAINED EC IGU” and filed on Nov. 24, 2015, which waspreviously incorporated in its entirety. In some cases, a sensor islocated on a frame, mullion, or adjacent wall surface. In certainembodiments, sensors in mobile smart devices may be used to aid inwindow control, e.g., as inputs to window control algorithms whensensors are available in smart devices also having window controlsoftware installed.

When installed, an environmental sensor is electrically connected to awindow controller or another controller having logic for collecting andprocessing data from the first sensing unit(s), the second sensingunit(s), and/or capacitive sensor(s). When located on an IGU, anenvironmental sensor may be electrically coupled to a controller viaconductive lines on the surface of a lite that connect to a pigtailconnector. As described elsewhere, pigtail connectors provide a pluginterface for electrically connecting a window controller to anelectrochromic device, window antennas, and/or other sensors andelectrical components of an IGU.

An environmental sensor may have a high sensing performance and be ableto discriminate between various gas pollutants. For example, the firstsensing unit may be reactive to first and second particles, while thesecond sensing unit may be reactive to second and third particles butnot the first particles. In this example, the presence of each of thefirst, second and third types of chemical particles in the air can bedetermined by evaluating a sensed response from the first sensingunit(s) in combination with the second sensing unit(s). In anotherexample, if a gas sensor has cross-sensitivity to a plurality of gasses,it may be difficult to determine what gas is being detected from asingle type of sensing unit. For example, if the first sensing unit hasa strong sensitivity to chemical A but is less sensitive to chemical B,the sensing logic may be unable to determine whether chemical A ispresent in a low concentration or chemical B is present in a highconcentration. When a second sensing unit is also used and has adifferent sensitivity to chemicals A and B (e.g., being more sensitiveto chemical B than to chemical A), then gas sensing logic may be able todiscriminate between the gasses. If the second sensing unit is locatedadjacent to the first sensing unit, it may be assumed that theconcentration of a sensed gas is similar at both units, and then thesensitivity difference of the two units may be used to discriminatebetween the two or more chemicals. In some cases, there may be three ormore types of sensing units on an IGU which may be used by sensing logicto discriminate between air pollutants. In some cases, an IGU may havemultiple gas sensors to compensate for sensor drift or instabilities.

Advanced Network Architectures:

FIG. 11a depicts the network architecture of current and commerciallyavailable window control systems. Each EC window has a window controller(WC), which in turn communicates with a network controller (NC), whichin turn communicates with a master controller (MC). Communication andcontrol can be done wirelessly, via a mobile app and/or via the cloud.Power is provided to windows through a trunk line cabling system, whichis modular and has a plug-n-play interface. In some cases, EC windowsare controlled based on sensor readings, e.g., based on the measuredlight intensities or based on measured temperatures. In some cases,windows are controlled via user input provided using the controlapplication. In other cases, windows can be controlled based on thelogic that considers the context, intensity, and angle of incidentlight. Once the desired tint level is determined, the drive commandstint the EC glass accordingly. In addition to automatic control based onlocal sensors an manual control provided through the controlapplication, Applicant's operating system can take into accountinformation provided by weather services, an occupant's physicallocation, and/or an occupant's schedule when determining the appropriatetint level for the window. Tint level adjustment may be performed inconjunction with indoor LED light luminosity & color adjustments andtemperature control.

FIG. 11b depicts an embodiment having a proprietary cloud-based softwarethat supports a window control network. The cloud-based software canstore, manage, and/or process basic functions such as sensing light,sensing air, sensing water, applying proximity context, executing tasks,controlling peripherals and providing an open interface for otherapplications. Transparent displays on the electrochromic windows enhancethe user experience by allowing users to interact directly with theglass, rather than using a mobile device or wall unit. By includingatmospheric sensors (not depicted) controllers may analyze air, water,light along with the occupant's context and/or personal data to create apersonalized user experience. Glass controllers can create mesh networkswith other digital systems in the building including LED lights, HVAC,and air filters. The glass controllers can work in conjunction withthese systems to keep an optimal ambient environment within the buildingand act as ‘data wall’ between indoor and outdoor environments.Proximity detection and user recognition that is sensed or provided byuser input can trigger glass personalization. The glass network specificinternet-hosted software interacts via the cloud with, e.g.,commercially available IoT digital systems, such as Nest, FB, Predix,IBM Watson++, etc. to augment and create integrated glass functions,including end-to-end data security and an IoT LTE network. Furtherembodiments include, partner eco-system powered glass functions withintheir application like building automation apps (e.g., Honeywell, J&Jcontrols), workplace apps (e.g., iOffice), service and ticketing apps(e.g., Service Now, personalization apps (e.g., IFTTT), IoTecosystem—asset tracking (e.g., Oracle IoT cloud), Smart Lighting (e.g.,Bosch, Philips, GE), Digital Ceiling (e.g., Cisco) and the like.

FIG. 11c depicts a network architecture where the electrochromic glassis 5G enabled. As in FIG. 11b , the EC glass includes on-glass control,e.g., transparent display controller on surface 4 (occupant side of thewindow) as depicted. FIG. 11d depicts the same architecture as in FIG.11c , but in this case, the transparent display is large, substantiallycovering the viewable portion of the window on surface S4. Thisarchitecture may include, as in previous embodiments, autopersonalization of glass upon proximity detection of the occupant, assetlocation tracking near the glass, etc. using, e.g., proximity and motionsensors. Having 5G network speed from glass to the cloud enables highbandwidth applications like full-HD display technology.

A full HD Display on (or as) the inner glass surface allows for variousdigital content to be displayed. Displayed digital content may include,e.g., signage, communication, a work collaboration space connected to apersonal computer, or graphical user interfaces (GUIs) for controllingwindows, sensors, or HVAC systems. In certain embodiments, e.g., insignage applications, there is a transparent LED Mesh on surface S1 (notdepicted) displaying signage to those outside the building, while stillallowing for occupants to simultaneously see out of the building.Adjusting the EC glass component of the system allows for contrastcontrol for inward and/or outward projecting transparent displaytechnology. In one embodiment, a two-way transparent display on, or asS4, is used both for inside occupant display as well as signage forthose outside the building. In one example, office buildings windows areused for occupant needs (e.g., providing a display, providing controlfunctions, and communication), during business hours, but used forexternal signage during non-business hours.

Having such capabilities greatly expands the utility and value ofbuilding windows/facades. In another example, some of the windows orareas of individual windows are used for signage, and simultaneouslyother windows or areas of individual windows are used for occupantdisplay, communication and control functions.

In some embodiments, a controller such as a master controller in thenetwork may include a CDN proxy for signage content for local playback.Any controllers of the window control system (e.g., a master controller,network controllers, and/or leaf controllers) may contain a 5G LTEnetwork controller.

In some embodiments, the IGU is configured with an RF modulator modulefor Wi-Fi, GSM blocking/allowing. As depicted in FIG. 11e , this enablesdrone-safe buildings. As in previous embodiments, this architecture caninclude embedded sensors (BLE, RF, proximity, light, temperature,moisture, 5G) on, in, or around the IGU, as depicted in FIG. 11f . TheIGU's window controller (e.g., an onboard controller) may be wirelesslypowered (as illustrated by the lightning bolt in the figure). Thisenables plug & play intelligent glass powered over a 5G network.

In some embodiments, the transparent display and/or another transparentlayer, includes photon cells (a type of photonic memory cell), which arecapable of storing not only power (photovoltaic function) but alsoinformation. A network of photon cells can enable onboard control wherethe window controller logic circuit is configured as a transparent grid,thus allowing for “sensor glass.” The transparent grid window controllercan be self-powered and mesh with other windows in the network as a trueplug and play system. The transparent window controller may or may notbe integrated or part of the transparent display component. Oneembodiment is an electrochromic IGU with a transparent on pane windowcontroller which receives power through photovoltaic cells.

In some embodiments, the IGU is configured with Light-Fidelity (Li-Fi)wireless communication technology, as depicted in FIG. 11g . LightFidelity is a bi-directional, high-speed and fully networked wirelesscommunication technology similar to Wi-Fi. It is a form of visible lightcommunication and a subset of optical wireless communications (OWC). Incertain embodiments, Li-Fi is used as a complement to RF communication(Wi-Fi or cellular networks), while in some embodiments Li-Fi is used asthe sole means of data broadcasting to and from the IGU. As Li-Ficarries much more information than Wi-Fi, it allows for virtuallyunlimited bandwidth for communication between the IGU(s) and the controlsystem.

Using Li-Fi enables radio free buildings, e.g., to obviate occupantexposure to RF radiation. A Li-Fi powered glass network provides ultraHD to devices inside the building (including the transparent displaycomponent(s) of the IGUs described herein) paired with high-speedexternal radio networks.

Use Cases:

The following description illustrates use cases associated withembodiments described herein. The description below may also includefurther embodiments. The architectures, configurations, hardware,software, etc. described herein allow for greatly expanded capabilitiesof building glass which therefore makes the building façade far moreuseful and valuable, e.g., not only to save energy, but also to increaseproductivity, promote commercial markets, and enhance occupant comfortand well-being. In the description below the term “the glass” may beused to mean the control network, the system architecture, the windowcontroller, interchangeably, to simplify the description. One ofordinary skill in the art would recognize that, along with the hardware,software, network and associated embodiments described herein, that “theglass” means the appropriate systems needed to perform whatever functionis described in the particular use case.

Proximity & Personalization:

The IGUs and glass control architectures described herein detect theproximity of the occupant near the glass (e.g., via a proximity sensoron the window controller) and control the ambient environment (e.g.,window tint, lighting, HVAC of the area where the user currently is) tothe occupant's preferences. For example, occupant preferences providedby the occupant or learned from previous encounters with the occupantcan be stored by the window control system. The glass network canintegrate with the BMS as well as the occupant sensor networks (e.g.,Nest, Hue, SmartThings, as well as activity networks, e.g., IFTTT) andhas a cloud-based intelligent rule engine (e.g., a glass IFTTT ruleengine) for determining the right ambience parameters as well as actionsand timing based on the occupant's activity.

The glass provides a personalized communication channel across naturallanguage voice commands and messaging bots (e.g., text messages, instantmessaging, chat, email and the like) to get information about theambient environment as well as set the ambient environment to theoccupant's preferred settings. Full HD displays integrated into the IGUsenable these personalization channels to drive specific content on glasspanel for enabling collaboration as well as communication. The glass ismapped to a building network, personal area network and IT-app contextnetwork cloud to drive seamless proximity and personalization to users.Some examples of proximity-based communication channels are illustratedin FIGS. 12a -12 b.

In another case, in a hospital setting, the glass can be programmed witha patient's care plan data. This is illustrated in FIG. 13. That alongwith sunlight information allows the glass to set the appropriate tintlevel of the glass, with or without augmentation by the transparentdisplay component and/or interior lighting and HVAC, to create anambient environment that is best suited for the patient's recovery.Moreover, the glass can change the ambient environment based on thevisiting doctor's preferences, or a balance between what the doctorprefers and the patient needs. The doctor's visit may be scheduled, andthus the glass can make changes in anticipation of the doctor's visit ornurse's visit. The transparent display can be used by the medicalpractitioner to bring up the patient's medical records, order aprescription medication, confer with a colleague via video conference,display x-rays, play a prerecorded presentation or tutorial for thepatient, etc. The doctor may also use the glass to find and/or trackassets, such as a crash cart or other medical supplies needed for thepatient. The doctor may also use the glass to find a colleague, set up ameeting with the colleague or call the colleague to the patient's roomfor a consultation. In another example, the doctor may arrive at thepatient's intended room before the patent and use the glass to identifywhere the patient is. For example, it may be the case that the patienthas not left surgery, has been taken to the x-ray facility or forphysical therapy, is in the lobby with family, or is in the nurseryvisiting their newborn baby. The doctor may use the glass to call thepatient back to the room, or simply wish them well.

In another example, in an office setting, a meeting schedule may allowthe glass to control the ambient in a meeting room, includingappropriate light and heat levels, considering occupant's personalpreferences as well as taking into account how many occupants willattend the meeting, if there will be a presentation, etc. The glass mayautomatically order lunch for the attendees based on their preferences(e.g., based on other apps that the glass interacts within the cloud)such as favorite foods, local restaurants, known food allergies, etc.Moreover, the glass may also automatically block telecommunications intoand from the meeting room if the meeting is about highly sensitivematters. The glass can obviate the need for projectors and screens inthe meeting room. The glass itself can be used as the presentationmedium for displaying slide presentations, video conferencing,whiteboard functions having read/write capabilities and the like. Inthis latter function, using HD displays and high-speed communicationprotocols, the notes written on the glass can be simultaneouslytransferred to attendees personal computing devices, whether in themeeting room or remotely situated. The transparent display may, e.g., beenabled for a wide spectrum of colors for such note-taking. As seen fromthese examples, the glass becomes a “digital skin” of a building,serving as an environmental shield, a telecommunications hub, aproductivity enhancement, etc. Some examples of transparent displaysbeing used for business, collaboration, video conferencing, andentertainment are shown in FIGS. 14a-14e

In another example, the glass can interact with other systems such asIBM Watson. In some cases, the window control system can use sensors formonitoring real-time building temperature or moisture data to createlocalized weather pattern data that can be pushed to the cloud. In somecases, this data can also aide in weather prediction, e.g., incollaboration with other buildings equipped with the glass. Asillustrated in, e.g., FIGS. 14a and 14b , the glass may include anatural language translation system. Also, the glass has acloud-to-cloud integration. This allows the transparent display tointeract with an occupant's other apps, enabling collaboration andcommunication using a programmable rules engine. In this example,ambient light and temperature control are coordinated with thebuilding's BMS, and buildings can interact with each other. For example,if a building on the west side of town encounters a rainstorm or coldfront, this information can be communicated to a building on the eastside of town, which can then adjust the HVAC and/or glass inanticipation of the storm or cold front.

Service Optimization:

Glass with transparent displays are listed as a digital asset in servicemanagement systems providing full-service lifecycle management duringdeployment and operations phase for seamless integration of the glass'operational management. This is achieved by integrating the glass'location and identification hierarchy into existing service lifecyclemanagement clouds like ServiceNow.

Industrial Automation:

Glass equipped with a transparent display can be integrated into anindustrial workflow automation cloud as an ambient control digitalasset. The glass provides an interface for control and feedback intobusiness operation workflow systems providing best ambient conditionsfor that workflow. For example, a tint level for an eye specialist'swindows may be different than the tint level for a patient room and tintsetting for an unoccupied patient room. In another example, anindustrial process requires low lighting during a particular chemicalprocessing phase due to the sensitivity of the reactants to light orheat. The tint level and/or UV blocking of the glass is adjusted toaccount for the sensitivity during that process flow or, e.g., in thatpart of the building where the flow is happening. During periods whenthe flow is not happening, the glass changes the ambient conditions forimproved lighting or other desired conditions. In another example, theglass is typically in a dark tint in a computer server facility toreduce the heat load on the servers. If a server malfunctions, theoccupant can be notified by the transparent display on the glass. Theglass can display the location of the malfunctioning server to theservice technician, and the system may clear the glass near themalfunctioning server to provide lighting for the technician duringrepairs or replacement of the server. Once the server is back online,the glass may adjust the proximate windows back to their tinted state toonce again protect the servers from heat load.

Efficient Workplace:

The glass in a building (e.g., in conference rooms, cafeterias, commonareas, executive suites, etc.) provides a distributed network digitalnodes integrated into workflow applications like email, calendaring,messaging (IM, email, text, providing policy driven ambient control forworkforce as part of their workday. When an occupant moves from a firstroom to a second room, items displayed via a transparent display to auser on in the first room may then be displayed to the user via theglass in the second room after authenticating the user. This allowsusers to easily access their own digital content while moving around thebuilding.

Glass Mesh Network:

The glass surface will serve multiple functions. In one embodiment theglass acts as a power generating membrane, e.g., transparent solar cellsand/or photovoltaic cells convert sunlight into electricity for poweringthe glass. In another example, the glass serves as an RF grid, capableof receiving and transmitting omnidirectional RF signals based onconfigured policies. If photon cells are used, they can storeinformation and/or power enabling a number of embodiments (e.g.,self-powered windows, and wireless communication and power distributionnetworks). In some cases, digital security can be enabled viatransmission of high-frequency RF waves around the building skin toprotect against unwanted RF signals leaving the building (and hence dataleakage) to any receiver outside building as well as seizing RFcommunication for external RF communication driven by drones and otherUAVs. The glass can also trigger the blocking action via an automateddrone gun integrated into the glass or, e.g. in a rooftop sensor of thebuilding. FIGS. 15a-15c depict an interaction between glass and friendlydrones 1502 and a non-friendly drone 1504. In FIG. 15a drones 1502 and1504 approach the glass and drone 1504 is identified as hostile. Thiscould be, e.g., because the drone is trying to transmit signals into thebuilding and/or take pictures of the interior of the building. Asdepicted in FIG. 15b , the glass 1506 can darken to block visualpenetration into the building and/or it can transmit RF signals to jamthe drone's operation and knock it out of the sky. This drone defeatingmechanism can be done selectively, as each window may have thiscapability. The glass can thus remove the offending drone while leavingthe friendly drones to go about their work as shown in FIG. 15 c.

In some embodiments, the glass can also detect potential intrudersoutside the building. For example, at 3 am a sensor may detect one ormore individuals outside a first-floor glass façade and alerts securitypersonnel as to their presence, potentially averting an intrusion intothe building. In another example, the glass automatically sensesbreakage and alerts a service technician that repairs are needed. Thisis illustrated in FIGS. 16a and 16b . In FIG. 16a an unbroken window1602 monitors for a security or safety threat. In FIG. 16b , the nowbroken window 1604 is detected, and appropriate action is taken—in thiscase, a notification may be sent to a repair technician. Breakage may bedetected by changes in current or voltage profiles of the electrochromiclite and/or the transparent display lite.

As described, the glass surface may serve multiple functions. In someembodiments, the glass acts as a mesh network that may be self-powered.In certain embodiments, a network of IGUs (windows) are powered byconventional wired power. In other embodiments, a network of IGUs ispowered wirelessly, e.g., using RF powering. In yet other embodiments, anetwork of IGUs is self-powered, using PV and/or photon cells. FIG. 17depicts an exploded view of an IGU having a first lite 1702 (e.g.,having an EC device coating), a solar panel grid (PV) 1704, an RFantenna grid 1706, a grid or layer of photon cells 1708, and second lite1710 (e.g., having a transparent display thereon). Some embodiments maynot include transparent display technology. Layers 1704, 1706, and 1708can be located on separate substrates within an IGU, or can be depositedon the interior or exterior surface of lite 1702 or lite 1710. A photoncell array or grid is used as a memory device. A network of photon cellscan enable onboard control where the window controller logic circuit isconfigured as a transparent grid, thus allowing for “sensor glass.” Thuswith photon cells, a transparent grid window controller is realized. Inthis embodiment, the transparent grid window controller is self-poweredand meshes with other windows in the network of IGUs. A transparentwindow controller may or may not be integrated or part of a transparentdisplay component. In some embodiments, the photon cell grid suppliessufficient power for the control functions of the electrochromic glass,but in other embodiments, as depicted, a PV array augments the photoncell grid. The RF antenna grid, capable of receiving and transmittingomnidirectional RF signals based on configured policies, allows forcommunication between IGUs and meshing functions.

Radio Transmission & Receiver:

Policy and event-driven firewalling allowing and blocking of RF signalsbetween exterior and internal building environments. For example, theglass can provide a full GSM, Wi-Fi spectrum coverage for buildingoccupants. Blocking internal Wi-Fi network coverage outside thebuilding. This is illustrated in FIGS. 18 a and 18 b. In FIG. 18a thewindows of a building are used to block devices located outside thebuilding from being able to connect to the buildings Wi-Fi network. InFIG. 18b , the glass of a building is used to provide a wireless networkwithin a building.

The table provided in FIG. 19 shows a number of configurations where anelectrochromic window, with or without transparent display technology,can serve as a signal blocking device and/or transmitter, e.g., awireless communication repeater that optionally can also block signalsfrom entering the interior of a building with IGUs so configured. Theasterisk in the table indicates alternative positions for a groundplane.

FIG. 20 depicts an electrochromic IGU 2000 (or laminate) that may act asa Wi-Fi passive signal blocking apparatus as well as a repeater Surface2 of the IGU 2000 has an EC device coating thereon (not shown).Selective exterior and interior radiating antennas (2002 and 2004) arepatterned on S1 and S4, with a Wi-Fi signal processing RF chip 2006 aspart of the window controller 2008. Surface 3 has a transparent RFshield (e.g., a ground plane that can be selectively grounded by thewindow controller). Therefore, this configuration can transmit andreceive Wi-Fi communications and block incoming communications ifdesired.

In certain embodiments, the EC window controller also serves as an RFspectrum master configurator, i.e., controlling incoming and outgoing RFcommunications as well as meshing functions with other IGU controllersand/or network and master controllers. Antennas may be etched ontransparent conductive coatings on one or more of the IGU's glasssurfaces. For example, omnidirectional antenna(s) etched on S1 forexterior network coverage to transmit internally into a building,omnidirectional antenna(s) etched on S4 for internal network coveragetransmitted to the external environment, and/or antenna(s) in and/or onmullions (window framing) providing full 360-degree coverage aroundglass of ‘configured’ spectrum & RF networks. Monopole or other RFantenna(s) can also be used in one or more of the aforementionedconfigurations. Such configurations provide blocking and repeaterfunctions and optionally for selected spectrum channels. Window antennasare further described in PCT patent application PCT/US17/31106, filedMay 4, 2017, and titled “WINDOW ANTENNAS,” which is herein incorporatedin its entirety.

Power Transmissions to Devices:

The glass' RF transmitter transmits high power beacon frames toauthorized receivers providing continuous power over RF radio spectrum.

Asset Tracking:

The glass' sensors detect movement of radio powered devices within thevicinity of the skin of the building providing real-time locationtracking mapped to access control or location policies ensuringun-authorized detection triggers an alert for remediation. Asillustrated in FIG. 13, asset tracking can be useful in situations suchas helping a doctor locate a patient or medical equipment. In somecases, on-demand asset location mapping clouds, such as the Oracle IoTasset tracking cloud, will now have enhanced visibility of assetmovements with-in the perimeter of the building, because the skin of thebuilding is now digitized with the glass. Additional method and examplesof asset tracking are described in PCT patent applicationPCT/US17/31106, filed May 4, 2017, and titled “WINDOW ANTENNAS,” whichhas previously been incorporated by reference.

Transparent Display on Glass:

A transparent light emitting diode screen can be etched on the exteriorand/or interior surface of the glass powered by a remote display busilluminating diodes for content getting served from cloud stored locallyat CDN controller for smooth rendering and also providing local gridcontrol for glass mesh network. This enables a number of capabilitiesfor windows described herein. In some cases, transparent displays canprovide on-glass tint control for the window as well as nearby zonepanels, as well as ambient environment sensor readings and status ofglass panel tint or other functions.

In some embodiments, external facing transparent displays, enable theexterior of the building to be converted into a building-size digitalcanvas. The exterior digital canvas can be used for displayingadvertisements and other digital content as depicted in FIG. 21. Incertain embodiments, the occupant's view of the outside is maintainedeven when the outside of the glass is used as a display. The occupantmay also use the inside surface of the glass as a display. In someembodiments, an HD transparent display on or as the inboard lite isequipped with touch and gesture sensors or microphones for receivinguser inputs—converting the surface of the glass into a digitalwhiteboard for impromptu ideation sessions, meetings, and othercollaborative efforts. In some cases, a transparent display may be useda video conference pane, may display information from connectedapplications, or may provide entertainment (e.g., by pairing with andproviding information from a user's personal device enablingover-the-air casting to the glass surface).

Glass Digital Twin:

Programmatic representation of the glass for applications to utilize theglass as a programmable surface allows various automated workflows. Insome cases, content may be auto-scaled for best rendering on the glassbased on the window's tint level. For example, a dynamic contentmanagement system can determine the best pixel transparency, depth, andcolor contrast for the content based on the ambiance surroundings of theglass panel. If, e.g., a car is parked outside the panel and reflectssunlight on the panel, the panel will need darker tinting to providesufficient contrast to the transparent display. In some cases, standardprogramming constructs can be used for modeling glass into digitalsystems. This may be, e.g., based on the availability of standard modelswithin application transport protocol headers. For example, HTTP/Sallows for auto-detection of glass as the edge of the digital networkthereby mapping the edge to standard templated operations allowed on theglass. An example is listed below.

<viewglass> <type:standard-panel> <function: tint> <level: 1-4><default-state: 1>  <type:display-panel> <function: external-led><content-src: URL> <display-resolution: UHD> <tint-level: 1-4><brightness: 0-100> <transparency: 0-100> <default-state: display-logo><surface: 1 or 4> <gesture: yes | no> <gesture-type: touch | motion><sensors: yes | no> <type: temp | proximity | light | RF><per-sensor-data-values> </viewglass>

Cellular Communications:

As discussed, antennas with windows allow the glass to be used as a cellrepeater, making buildings into cell towers (as well as boosters forcell traffic internal to the building). This, along with 5G capabilitiesas described, obviates the need for obtrusive cell towers, especially inurban areas. FIG. 22a depicts current cellular infrastructure. FIG. 22bdepicts an improved cellular infrastructure that makes use of buildingshaving windows with antennas that can replace or work in conjunctionwith existing cell towers. Buildings equipped with such windows have thepotential to greatly expand the coverage of cellular network in denseurban areas.

Glass Cleaning and Maintenance:

Sensors in or on the glass can, in some cases, detect dust level onglass and/or graffiti. In some cases, a window control system can informa cleaning scheduling system to schedule cleaning once dust level hasreached a threshold value, or when graffiti is detected. Windowsdescribed herein may have self-cleaning type coatings on the outboardlite to aid in maintaining clear views, such as titanium dioxidecoatings that catalyze breakdown of organic contaminants and allow therain to remove debris.

Glass Façade for Data Storage (Memory) and Networks:

Since photon cells (sometimes called photon sensors) can store energyand data, and onboard window controllers or associated network or mastercontrollers may have significant storage and computing horsepower, thebuilding skin, the glass itself in the former example, can be used asdata storage cells. Since large buildings may have tens or hundreds ofthousands of square feet of glass on the façade, this can account forsignificant storage and/or computational power that can be used forpurposes other than tinting the windows and displaying information. Forexample, besides data storage for a building occupant, the glass can beused as an external network providing connectivity to the internet orforming in-building intranets (e.g., on the side of the building, floorof the building, rooms in the building, etc.). This is illustrated inFIG. 23. The glass, 2302 can act as a bridge between an ultra-high speedexternal network 2304 to many intra-building high-speed networks 2306and 2308 for voice, video and data communication. Moreover, by virtue ofpiezoelectric elements and/or PV cells, the glass can generate energyfrom the wind and or solar energy and supply power to the memory and/ornetwork transmission infrastructure. In some cases, a window controllermay have a battery for storing generated energy.

Personal Computing Via a Window Network

In certain embodiments, components of a building's window system areused as a personal computing system, providing a building occupant withfunctions commonly found in a personal computer such as a desktopcomputer, a laptop computer, a tablet computer, and/or a smart phone.Personal computing units implemented as described herein may havevarious benefits. For example, they may allow sharing window systemresources among multiple computing platforms (e.g., windows/displays) ina building, and they may allow using spare window system resources inthe form of processing power and/or storage. Personal computing unitsalso allow users to access the personal computing functions whileuntethered to computing device.

Examples of features of conventional personal computing devices that canbe replaced by one or more components of a window system include thefollowing: (a) user interface components such as a display screen, touchsensor, speaker, and/or microphone, (b) one or more processors such asmicroprocessors configured to execute instructions that facilitatepersonal computing, (c) memory or storage for permanently or temporarilystoring data useful to occupants and/or instructions/data for executingon the processor(s), (d) data transfer components that providecommunications and/or power conduits between (i) the user interfacecomponents and (ii) the processor(s) and/or the memory/storage, andoptionally (e) computer network components for communicating betweenpersonal computing units in a LAN or WAN and/or with an external networksuch as the Internet.

Terminology

As used for personal computing embodiments discussed herein, a “personalcomputing unit” is a group of window system resources that collectivelyprovide a user such as a building occupant with the functionality of apersonal computing device such as a personal computer, a tablet, and/ora smart phone. The required window system resources may be arranged forthis purpose temporarily (e.g., when needed by a building occupant) orpermanently.

As used for personal computing embodiments discussed herein, a “windowsystem resource” is a component of a window system that can be used fora personal computing unit. In many instances, a window system resourceserves other functions as well. For example, window system resourcestypically support window system operations such as controlling thebuilding environment by varying window tint states. As indicated,examples of window system resources include display screens, processors,memory or storage, data transfer components, and computer networkcomponents. In certain embodiments, window system resources are found onwindow controllers, network controllers, master controllers, sensors,the windows themselves, and/or network media links between two or moreof these components. In certain embodiments, window system resourcesinclude one or more components of an optically switchable window powerdistribution network. Examples of such components include controlpanels, trunk lines, drop lines, and connectors.

Window system resources available for personal computing units may be afraction of or all of the window system resources in a building. In somecases, the available window system resources include window systemresources available in two or more buildings, which may be, for example,on a campus or a housing group (e.g., a retirement community).

A user of a personal computing unit may be a building occupant such as afull-time occupant (e.g., a tenant or owner), a part-time occupant suchas a client of a shared workspace, or a visitor. Essentially, anyone whocan access some or all of the window system resources can be a user of apersonal computing unit. Of course, the window system may be configuredso that only authorized individuals are permitted to use window systemresources in a personal computing unit. In some embodiments, personalcomputing units are made available as a service by a building owner orother administrator of window system resources. For example, buildingoccupants or visitors are given access to personal computing units bysubscription, lease, or as needed (ad hoc) upon appropriate arrangementwith the building/administrator.

Window System Resources for Personal Computing Units

User Interface

A user interface for a personal computing unit may include any one ormore of the following personal computing output components, any one ormore of which may be part of a window system: a display screen, aspeaker, and a vibration generator or other tactile interface. Any oneor more of these may be integrated with a window or window componentsuch as an optically switchable window lite, a frame, an IGU spacer, amullion, a transom, a window controller, etc.

A user interface for a personal computing unit may include any one ormore of the following personal computing user input components, any oneor more of which may be part of a window system: a touch interface on awindow or a display screen associated with an optically switchablewindow, a keyboard (optionally displayed on a display screen associatedwith an optically switchable window), a computer mouse, a microphone,and a pressure transducer that senses how much pressure a user appliesto an input component such as a touch screen or mouse.

A user interface for a personal computing unit may include associatedsoftware or other logic for interpreting user inputs and controllingoutputs presented to the user. Such logic may implement a full range ofUI decision making, as appropriate for particular applications, found inuser interfaces employed in conventional personal computing. Examples ofuser interface logic functions include identifying user inputs thattrigger defined user interface outputs such as moving icons, launchingspecific applications, and displaying UI features such as menus, popupwindows, etc. In certain embodiments, the user interface employsancillary logic such as voice recognition algorithms, drivers for inputdevices such as touch sensitive screens, etc., and content renderingtools.

While the user interface may be wholly or partially implemented usinghardware of a window system (e.g., displays), in some embodiments, theuser interface is provided using components outside the window system.For example, the window system may lend processors, memory, and/ornetwork infrastructure, but not a user interface, to the personalcomputing unit.

Processors

A personal computing unit employs one or more processors for executinginstructions necessary to implement an operating system, a userinterface, one more software applications, etc. In certain embodiments,the processors are installed on a window network, in some casesprimarily for window-related purposes such as controlling tint states onoptically switchable windows. Such processors may have extra processingcapabilities that can be harnessed by personal computing units forpersonal computation.

Various types of processor may be used for personal computing units. Incertain embodiments, the processors are integrated circuits, typicallyelectrically connected to other components such as memory or storage,peripherals, and sometimes to other computer chips controlling ancillaryfunctions such as wireless communications, wireless power delivery, etc.In certain embodiments, the processors are microprocessors ormicrocontrollers, used alone or as part of a more complete processingsystem such as a system on a chip.

As is known to those of skill in the art, a microprocessor is a computerprocessor that incorporates functions of a central processing unit (CPU)on a single integrated circuit or at most a few integrated circuits. Amicroprocessor may contain one or more CPUs, sometimes referred toprocessor cores. A microprocessor is typically a multipurpose,clock-driven, register-based, digital-integrated circuit that acceptsbinary data as input, processes it according to instructions stored inits memory, and provides results as output. Microprocessors may containboth combinatorial logic and sequential digital logic.

Microcontrollers are designed for embedded applications in contrast tomicroprocessors used in general purpose applications. However, like amicroprocessor, a microcontroller contains one or more CPUs along withmemory. A microcontroller may also include programmable input/outputperipherals and may include program memory in the form of, e.g.,ferroelectric RAM, NOR flash, or OTP ROM, as well as a small amount ofRAM.

As explained, the processors are configured to execute instructions fora personal computing unit's operating system, user interface, softwareapplications, etc. As is known to those of skill in the art, anoperating system (OS) is system software that manages computer hardwareas well as software resources and provides common services for computerprograms. For hardware functions such as input and output and memoryallocation, the operating system acts as an intermediary betweenprograms and the computer hardware, although the application code isusually executed directly by the hardware and frequently makes systemscalls to an OS function or is interrupted by it. An OS may also scheduletasks for managing processor time, mass storage, and the like. Theoperating system for a personal computing unit may be different from theoperating system used by the window system for its own purposes such asreporting

Processors used in personal computing units described herein may beprovided on any of various window system resources, or they may bededicated for the personal computing unit but are configured to connectwith other window system components such as displays and/or memory. Invarious embodiments, the processors are provided on window systemcontrollers such as window controllers, network controllers, or mastercontrollers.

Multiple processors, sometimes contained on two or more window systemcontrollers, may operate in concert to implement the processingrequirements of a personal computing unit. In such cases, a distributedprocessing control mechanism may be necessary to coordinate theoperation of the multiple processors. In certain embodiments,distributed processing for a personal computing unit is implemented in apeer-to-peer or a master-slave configuration. In certain embodiments,the distributed processing system employs a block chain technology suchas Bitcoin or the open source program Gridcoin that uses the BerkeleyOpen Infrastructure for Network Computing. To implement distributedprocessing, software for interfacing with the processors may have acontainer architecture. In some embodiments, the container architectureis implemented via a container management layer in a network protocol.One example of resource for implementing distributed processing via acontainer architecture is Docker for the Linux Containers (LXC) format.Docker provides namespaces to isolate an application's view of theoperating system, including process trees, network resources, user IDs,and file systems. The distributed processing may allow load balancing byusing a product such as, for example, IBM's Cloud Orchestrator™.

The computing power of a personal computing unit is a function of (i)the power of individual processors and (ii) the number of suchprocessors working in concert. In some cases, many processors throughouta building or even throughout multiple buildings are used by a personalcomputing unit or are at least available to the personal computing unitduring its operating session. Because the processing power grows withthe number of available processors, a personal computing unit may insome cases attain much greater processing power than is conventionallyavailable with a personal computing device.

The processing resources for a personal computing unit can be chosenbased on various criteria. The current and/or projected availability ofspare processing power when a personal computing unit is established maybe one criterion. The physical location of processors may be anothercriterion. The ability of processors to participate in a multi-processorcomputing environment may be still another criterion. In one example,multiple processors are selected for inclusion in a personal computingunit and configured in a manner that allows them to conduct fogcomputing. Fog computing also known as fog networking or fogging, is adecentralized computing infrastructure in which data,computing/processing power, storage, and applications are distributed inthe most logical, efficient place between a data source and a user. Ifan external network (e.g., the internet or a cloud computing resource)are involved, the computing infrastructure is chosen taking intoconsideration the location of relevant cloud or internet resources.

In certain embodiments, mobile devices and/or other computing devicesthat are not physically part of the window system may be temporarilyconnected to the window system and thereby become available as a windowsystem resource for a personal computing unit. In a sense, such externaldevices may serve as part of virtual window resource and provide itsuntapped processing power for an occupant/computational user of apersonal computing unit.

Memory/Storage

A personal computing unit employs memory to provide instructions anddata used by the processor(s) to run the operating system, userinterface, applications, etc. A personal computing unit may also employthe memory and possibly larger capacity storage devices to save resultsoutput by the processor(s). Suitable memory and optionally storage maybe provided by window system resources such as window controllers,network controllers, master controllers, and/or window or displays thathave spare memory not currently used by the window system.

As understood by those of skill in the art, memory refers to computerhardware that, e.g., stores information for immediate use in thepersonal computing unit. The term “primary storage” is sometimes used todescribe memory configured for this purpose. This form of computermemory is frequently implemented using RAM, which operates at relativelyhigh speed compared to “storage” that provides slow-to-accessinformation but offers higher capacities.

In certain embodiments, the memory is addressable semiconductor memory,i.e. integrated circuits containing transistors or other switches foraccessing storage units. Memory may be volatile or non-volatile.Examples of non-volatile memory include flash memory (sometimes used assecondary memory) and ROM, PROM, EPROM, EEPROM (sometimes used forstoring firmware such as BIOS). Examples of volatile memory includedynamic random-access memory (DRAM), which is often used for primarymemory, and static random-access memory (SRAM), which is often used forCPU cache memory.

Most memory is organized into memory cells or bistable flip-flops, eachstoring one bit (0 or 1). Flash memory organization may provide forstorage of one bit per memory cell or of multiple bits per cell (calledMLC, Multiple Level Cell). Memory cells are grouped into words of fixedword length, for example 1, 2, 4, 8, 16, 32, 64 or 128 bits. Each wordcan be accessed by a binary address of N bit, making it possible tostore 2^(N) words in the memory. Processor registers normally are notconsidered as memory, since they only store one word and do not includean addressing mechanism. Typical storage devices include hard diskdrives and solid-state drives.

Memory as described above may be provided on window system controllersand/or sensors in a conventional architecture or environment forinteracting with the controller's processor and providing opticalswitching functionality to optically switchable windows of the windowsystem. Examples of suitable architectures are described in PCTPublished Patent Application No. PCT/US16/58872, filed Oct. 26, 2016,previously incorporated by reference, and PCT Published PatentApplication No. PCT/US16/55709, filed Oct. 6, 2016, which is nowincorporated herein by reference in its entireties. Alternative orancillary memory sources may be employed. For example, photon cells asdescribed above, which may have a photovoltaic function and a memorystorage function that can provide memory or storage for personalcomputing units. Still further, as mentioned above in the context ofprocessors, mobile devices and/or other computing devices that are notphysically part of the window system may be temporarily connected to thewindow system and thereby become available as a window system resourcefor a personal computing unit. Such external devices may provideuntapped memory/storage for a personal computing unit. In someembodiments, memory resources from multiple buildings (e.g., memory onwindow controllers of multiple buildings) are made available for apersonal computing unit.

Software useful for implementing a personal computing unit may be storedon one or more storage devices provided on the window system. Suchsoftware may include operating system software, applications software,user interface software, compilers, and the like.

In certain embodiments, a personal computing unit uses memory or storagefrom multiple window system resources. In such cases, the memory may bevirtualized with a given personal computing unit employing memory fromone or more virtual drives, with each such virtual drive mapping tophysical memory spread across multiple physical devices such as multiplewindow controllers or other window system resources. Examples ofapproaches to sharing memory across multiple physical devices includeNetwork Attached Storage (NAS), Network File System (NFS), or StorageArea Network (SAN).

While the memory and storage of a personal computing unit may be whollyor partially implemented using hardware of a window system (e.g., onwindow controllers, network controllers, or master controllers), in someembodiments, memory or storage is provided via components outside thewindow system. For example, the window system may provide processors,user interface components, and/or network infrastructure, but not memoryand/or storage required by a personal computing unit.

Buses or Data Transfer Components

To permit direct communication between its processor(s), memory,peripherals, etc., a personal computing unit employs one or more dataand power links, sometimes called buses. In some cases, these links orbuses are supplied together with the processors used by the personalcomputing unit. In other cases, these are provided separately. Whenseparate bus functionality is needed, the window system may provide itvia many different forms such as USB, expansion ports, SATA ports, etc.In some cases, the necessary links are provided via a computer network.

Generally, a bus is a communication system that transfers data betweencomponents inside a computer or between computers. The expression coversall related hardware components (wire, optical fiber, etc.) andsoftware, including communication protocols. Suitable buses for personalcomputing units can use parallel and/or bit serial connections, and canbe wired in either a multidrop (electrical parallel) or daisy chaintopology, or connected by switched hubs, as in the case of the UniversalSerial Bus (USB).

In many embodiments, the processor and main memory of a windowcontroller or other window system component are tightly coupled. Amicroprocessor conventionally has a number of electrical connections onits pins that can be used to select an “address” in the main memory andanother set of pins to read and write the data stored at that location.In most cases, the processor and memory share signaling characteristicsand operate in synchrony. The bus connecting the processor and memory isoften referred to simply as the system bus.

Peripherals such as displays on windows may communicate with memory inthe same fashion by attaching adaptors in the form of, e.g., expansioncards directly to the system bus. This may be accomplished through somesort of standardized electrical connector, with multiple of theseforming an “expansion bus” or “local bus.” Some processors have a secondset of pins similar to those for communicating with memory, but able tooperate at very different speeds and using different protocols. Othersuse smart controllers to place the data directly in memory, a conceptknown as direct memory access (DMA).

Certain bus systems are designed to support multiple peripherals. Commonexamples are the Serial AT Attachment (SATA) ports, which allow a numberof hard drives to be connected without the need for a card, and thestandardized USB.

In some cases, high-speed memory, known as a cache, is built directlyinto the CPU or other processor of the window system. In such systems,CPUs communicate using high-performance buses that operate at speedsmuch greater than memory, and communicate with memory using protocolssimilar to those used solely for peripherals. These system buses arealso used to communicate with most (or all) other peripherals, throughadaptors, which in turn talk to other peripherals and controllers. Suchsystems are architecturally more similar to multicomputers, butcommunicate over a bus rather than a network. In these cases, expansionbuses are entirely separate and no longer share any architecture withtheir host CPU (and may in fact support many different CPUs, as is thecase with the Peripheral Component Interconnect (PCI)).

Other categorizations are based on the bus's role in connecting devicesinternally or externally, PCI versus Small Computer System Interface(SCSI) for instance. However, many common modern bus systems can be usedfor both; SATA and the associated eSATA are one example of a system thatwould formerly be described as internal, while certain applications usethe primarily external IEEE 1394 in a fashion more similar to a systembus. Other examples, like InfiniBand and I²C were designed from thestart to be used both internally and externally.

In the context of a personal computing unit employing window systemresources, bus components such as ports and adaptor for personalcomputing may be added to the existing window system resources by, forexample, installing them on controllers, sensors, and the like.Alternatively, such features may be installed as separate components, inline between components such as controllers.

Computer Network Infrastructure

A personal computing unit may require computer network services orcomputer network infrastructure, which may be used to communicate withother computers on the network, access the internet, etc. In certainembodiments, a window network provides some or all of this service orinfrastructure. The wired or wireless links between window controllers,network controllers, master controllers, and/or sensors on the windownetwork can be used by personal computing units. Further, some or all ofthe controllers on the window network may serve as routers or bridgesfor a personal computing unit's network. In certain embodiments, thewindow network provides a route for communicating user input andprocessing results between user locations in a building and thelocation(s) of the processing power (possibly the cloud or otherlocation outside the building).

Note that network connections such as Ethernet connections are notgenerally regarded as buses, although the difference may be consideredlargely conceptual. An attribute generally used to characterize a bus isthat power is provided by the bus for the connected hardware.

For purposes of the personal computing units described herein, acomputer network is a digital communications network that allows nodes(including personal computing units) to share resources. In computernetworks, computing devices exchange data with each other usingconnections between nodes (referred to as data links). These data linksare established over cable media such as wires or optic cables, orwireless media such as WiFi. In many cases, network communicationsprotocols are layered over other more general communications protocols.

Users of personal computing units may communicate efficiently and easilyvia various network-enabled functions such as email, instant messaging,online chat, telephone, video telephone calls, and video conferencing. Anetwork allows sharing of network and computing resources. Users mayaccess and use resources provided by devices on the network, such asprinting a document on a shared network printer or use of a sharedstorage device. A network allows sharing of files, data, and other typesof information giving authorized users the ability to access informationstored on other computers on the network. A network may also permitdistributed computing, as described herein, which uses computingresources across a network to accomplish tasks.

In certain embodiments, personal computing units access softwareapplications and/or other services via a cloud or the internet. Asexamples the architectures presented in FIGS. 7 and 11 a-g may beemployed.

In certain embodiments, antennas or other communications components areprovided on optically switchable windows or associated lites ordisplays. Such antennas are described in PCT Patent Application No.PCT/US17/31106, filed May 4, 2017, which is incorporated herein byreference in its entirety.

While the data transmission network infrastructure of a personalcomputing unit may be wholly or partially implemented using hardware ofa window system (e.g., on network interfaces and/or wired or wirelesslinks between window, network, and/or master controllers), in someembodiments, the network infrastructure is provided via componentsoutside the window system. For example, the window system may lendprocessors, user interface components, and/or memory/storage, but notnetwork infrastructure, to a personal computing unit.

Configuring Logic

Software or other logic is designed or programmed to control allocationand coordination of window system resources to so that the resourcesserve, at least temporarily, as personal computing units. Thisconfiguring logic may be resident on a window system resource (e.g., oneor more master controllers, network controllers, or window controllers)and/or it may be provided outside the window system. In variousembodiments, the configuring logic performs some or all of the followingfunctions:

1. Authenticate or authorize a user to allow the user to access apersonal computing unit.

2. Identify and select window system resources available to serve as thepersonal computing unit for the user.

3. Allocate some or all of the selected window system resources as thepersonal computing unit for a defined period of time.

4. Configure as necessary the allocated window system resources tocoordinate effort as the personal computing unit. This may involverunning an instance of an operating system on the personal computingunit, applying a network address (e.g., an IP address) to the personalcomputing unit, applying a level of computer security appropriate forthe user and personal computing resource, etc. As an example, a user maybe given a role that defines access to particular content, ports,physical resources of the window system, etc. A network firewall mayalso be appropriately configured.

5. Oversee and monitor operation of the allocated window systemresources during their use in the personal computing unit.

6. Upon detecting a defined event such as expiration of a timer,terminating use or deallocating the window system resources used in thepersonal computing unit. In this regard, the availability of the windowsystem resources for a particular personal computing unit may be deemeda personal computing session. Users may have one or more personalcomputing sessions at various times and/or various locations throughouta building.

Operation and Function of Personal Computing Units

Any combination of available window resources may be configured for agiven user's personal computing unit. Typically, the user interfacecomponents of the personal computing unit (e.g., the display screen,tactile interface, speaker and/or microphone) are located in closeproximity to the user, e.g., sufficiently close to allow the user touch,view, speak, or otherwise interact with the user interface. As explainedherein, proximity detection can be used to determine the location ofparticular individuals. Alternatively, the user can take action toinitiate deployment of available window system resources as the user'spersonal computing unit. For example, the user may touch an icon on adisplay associated with an optically switchable window—the icon beingdedicated to launching/configuring a personal computing unit—or the usermay send a request from her smart phone, watch, or table.

Upon triggering a request for resources and a subsequent decision tomake resources available as a personal computing unit, the responsiblelogic configures available window system resources as a personalcomputing unit for the user. Window system resources are available ifthey have spare computing power, transmission bandwidth, and/or storagecapacity, which may be determined by current and/or projected needs ofthe window system, of other building systems sharing the resources(e.g., a BMS), or of other personal computing units. The projected needsmay be determined based on the typical usage patterns of the windowsystem, the other building systems, and/or the users of personalcomputing units.

Once the logic for configuring personal computing units determines thata particular user should be given access to window system resources forpersonal computing, the logic takes actions to allocate and configurethose resources as a personal computing unit for the particular user.Allocation of resources may involve defining a period of time when thepertinent window system resources are available as a personal computingunit for the user and optionally preventing other users or systems fromaccessing those resources during the period of time. In some cases,other users or systems are permitted some, but not all, of power orcapacity of the allocated resources during the period. Configuring ofresources may involve taking steps to cause the resources to coordinatetheir operation and communicate directly with another for the purpose ofpersonal computing with a user. Also, as mentioned, some processor andmemory/storage resources are available across multiple window systemcomponents. For example, multiple window controllers may be allocatedfor a single personal computing unit. While allocated the personalcomputing unit, the processors and/or memories of these controllers maybe available to both the personal computing unit and one or morebuilding systems. The amount and timing of the processing and storagecapacity available to the personal computing unit is controlled by adistributed processing and/or distributed memory tool such as the blockchain, load balancing, and/or memory virtualization tools describedelsewhere herein.

After a user concludes his or her use of a personal computing unit, theconfiguring logic may deallocate the window system resources so thatthey are no longer encumbered by the personal computing unit. At a latertime, the user may again use a personal computing unit, and at that timethe configuring logic may allocate the same or different window systemresources. In various embodiments, the selection of particular physicalresources for a personal computing unit is not observable by the user.

Examples of user interface arrangements and computer applications for apersonal computing unit are depicted in FIGS. 14a -e.

A personal computing unit may provide the functionality of various typesof personal computing devices. For example, functions of a personalcomputer such as a desktop computer, a laptop computer, a smart phone, atable, or a smart watch may be replaced by various combinations ofwindow system resources. For example, a display associated with anoptically switchable window may serve as a computer monitor (and hencepart of a user interface) and one or more processors of one or morewindow controllers may provide computing power.

In some cases, a personal computing unit employs certain resources fromwithin the window system and other resources from outside the windowsystem. In one example, a display associated with an opticallyswitchable window is a computer monitor (and hence part of the personalcomputing unit's user interface), and a window network, or componentsthereof, provides a communications path between the display associatedwith an optically switchable window. However, the processing power isnot provided by the window system (e.g., processors used by the personalcomputing unit are not in any of the controllers of the window network).

In other examples, a window network provides capability for deliveringprocessing power for the personal computing unit, but the processingpower is supplied by processors outside the window system. In some suchexamples, the user interface is supplied by the window system, but itmay be viewed as a “dumb” device analogous to a computer terminal. Inother examples, user devices such as phones with limited computing powerreceive external processing power via the window network. In some cases,user mobile devices or local desktop devices provide the user interfaceand the window network provides processing, either directly orindirectly.

In certain embodiments, the personal computing unit employs thefollowing window system resources that go beyond the functionalityprovided in conventional personal computing devices. In one example, thepersonal computing unit employs a projector associated with an opticallyswitchable window. Such personal computing unit optionally uses a windownetwork infrastructure and/or processors and memory of windowcontrollers. In another example, the personal computing unit employs asmart whiteboard provided with the window system.

In certain embodiments, window system resources for a personal computingunit are provided from multiple buildings sharing a window platform andassociated computing resources, e.g., an academic or business campusthat has many buildings. If all buildings have optically switchablewindows and associated window resources, they can be made available towork in a coordinated fashion for computing, e.g., providing asupercomputing platform. In some cases, the computing power beingutilized in a personal computing unit may move from one building toanother, without necessarily interrupting the computations. For example,a user may be start conducting a computing session in one building andthen walk to a different building without interrupting the operation ofthe personal computing unit.

User identification, authentication, and/or authorization to access thewindow system resources configured as a personal computing unit may beperformed in various ways, such as by mechanisms that are conventionallyused in other computing contexts; e.g., password entry, biometricidentification, multi-factor authentication, etc.

User proximity and personalization may trigger user authentication andconcomitant configuring of window system resources near the user as apersonal computing unit for the user. In some cases, users may have beenpreviously authenticated or otherwise approved for accessing certainwindow system resources. Then, when the user's presence is detected, theavailable resources are configured as a personal computing unit for theuser. In some cases, the user is invited via a display message and/or anaudible communication to use the personal computing unit or to interactwith the user interface of the personal computing unit.

In certain embodiments, the user interface of the personal computingunit is implemented in a way that provides privacy. For example, adisplay screen or projector may be implemented in a manner that displayscontent to only the user. This may be accomplished by, for example,providing an opaque tint state to an optically switchable window thatoverlays the display screen. In another approach the display screen ismovable (e.g., via a pivot or swing arm) to a position that does notface through the window. Thus, content is not visible to individualslocated on a side of the window that is opposite from the side where theuser of the personal computing unit is located.

As indicated, virtualization services allow functionally discretememory, processing power, and personal computing units that are notfixed to particular physical components of a window system. Suchvirtualization allows the logic for configuring personal computationunits to allocate computational resources in a balanced fashion thatoptionally applies a hierarchical priority based on quality of service.Further the logic may be configured to segregate computers or networksso that only some users or tenants can access computational resources ornetworks. Any of these functions may leverage existing virtual network,database partitioning, computer security mechanisms, etc.

CONCLUSION

It should be understood that the certain embodiments described hereincan be implemented in the form of control logic using computer softwarein a modular or integrated manner. Based on the disclosure and teachingsprovided herein, a person of ordinary skill in the art will know andappreciate other ways and/or methods to implement the present inventionusing hardware and a combination of hardware and software.

Any of the software components or functions described in thisapplication, may be implemented as software code to be executed by aprocessor using any suitable computer language such as, for example,Java, C++ or Python using, for example, conventional or object-orientedtechniques. The software code may be stored as a series of instructions,or commands on a computer-readable medium, such as a random-accessmemory (RAM), a read-only memory (ROM), a magnetic medium such as ahard-drive or a floppy disk, or an optical medium such as a CD-ROM. Anysuch computer readable medium may reside on or within a singlecomputational apparatus, and may be present on or within differentcomputational apparatuses within a system or network.

Although the foregoing disclosed embodiments have been described in somedetail to facilitate understanding, the described embodiments are to beconsidered illustrative and not limiting. One or more features from anyembodiment may be combined with one or more features of any otherembodiment without departing from the scope of the disclosure. Further,modifications, additions, or omissions may be made to any embodimentwithout departing from the scope of the disclosure. The components ofany embodiment may be integrated or separated according to particularneeds without departing from the scope of the disclosure.

Although the foregoing embodiments have been described in some detailfor purposes of clarity of understanding, it will be apparent thatcertain changes and modifications may be practiced within the scope ofthe appended claims. It should be noted that there are many alternativeways of implementing the processes, systems, and apparatus of thepresent embodiments. Accordingly, the present embodiments are to beconsidered as illustrative and not restrictive, and the embodiments arenot to be limited to the details given herein.

What is claimed is:
 1. A personal computing unit comprising: (a) awindow system resource selected from the group consisting of: (i) adisplay associated with an optically switchable window, (ii) one or moreprocessors of one or more controllers on a window network connected to aplurality of optically switchable windows in a building, wherein the oneor more controllers are configured to vary tint states of the pluralityof optically switchable windows in the building, (iii) memory of one ormore controllers on the window network connected to the plurality ofoptically switchable windows in the building, and (iv) at least a partof the window network, wherein the window system resource is connectedto other window systems resources by the window network; and (b) logicconfigured to allocate and control the window system resource in thepersonal computing unit made available to a user in the building.
 2. Thepersonal computing unit of claim 1, wherein the one or more controllersinclude at least one window controller.
 3. The personal computing unitof claim 1, further comprising a touch sensitive interface.
 4. Thepersonal computing unit of claim 1, wherein the logic is furtherconfigured to allocate and control at least two window system resourcesin the personal computing unit.
 5. The personal computing unit of claim4, wherein the at least two window system resources comprise: thedisplay associated with an optically switchable window and the one ormore processors of the one or more controllers on the window network. 6.The personal computing unit of claim 5, wherein the at least two windowsystem resources further comprise: the memory of one or more controllerson the window network.
 7. The personal computing unit of claim 5,wherein the at least two window system resources further comprise: theat least part of the window network.
 8. The personal computing unit ofclaim 1, wherein the logic is further configured to allocate and controlwindow system resources in the personal computing unit for only adefined period of time or until an event is detected.
 9. The personalcomputing unit of claim 1, wherein the logic is further configured tocoordinate or trigger coordinating the use of multiple physical memoriesor storage devices for the personal computing unit.
 10. The personalcomputing unit of claim 1, wherein the logic is further configured tocoordinate or trigger coordinating the use of multiple processors forthe personal computing unit.
 11. The personal computing unit of claim 1,wherein the logic is further configured to temporarily provide anoperating system for running on the personal computing unit.
 12. Thepersonal computing unit of claim 1, wherein the logic is furtherconfigured to permit the personal computing unit to access one or moresoftware applications.
 13. The personal computing unit of claim 1,wherein the logic is further configured to permit the personal computingunit to access one or more internet sites.
 14. A method of configuringwindow system resources to provide a personal computing unit for a user,the method comprising: (a) selecting window system resources to serve ascomponents of the personal computing unit for the user; (b) allocatingsome or all of the window system resources selected in (a) as at least aportion of the personal computing unit for a defined period of time; and(c) configuring the window system resources allocated in (b) tocoordinate effort as the personal computing unit.
 15. The method ofclaim 14, wherein configuring the windows systems resources allocated in(b) comprises running an instance of an operating system on the personalcomputing unit.
 16. The method of claim 14, wherein configuring thewindows systems resources allocated in (b) comprises applying computersecurity based on information about the user.
 17. The method of claim14, further comprising identifying, authenticating, and/or authorizingthe user prior to permitting the user to access the personal computingunit.
 18. The method of claim 14, further comprising monitoringoperation of the window system resources configured in (c) during theiruse in the personal computing unit.
 19. The method of claim 14, furthercomprising, upon detecting a defined event, terminating use ordeallocating the window system resources configured in (c).
 20. Themethod of claim 14, wherein the window system resources allocated in (b)comprise: (i) a display associated with an optically switchable window,(ii) one or more processors of one or more controllers on a windownetwork connected to a plurality of optically switchable windows in abuilding, wherein the one or more controllers are configured to varytint states of the plurality of optically switchable windows in thebuilding, (iii) memory of one or more controllers on the window networkconnected to the plurality of optically switchable windows in thebuilding, (iv) at least a part of the window network, and (v) anycombination thereof.
 21. The method of claim 20, wherein the one or morecontrollers include at least one window controller.
 22. The personalcomputing unit of claim 20, wherein the window system resourcesallocated in (b) comprise: the display associated with an opticallyswitchable window and the one or more processors of the one or morecontrollers on the window network.
 23. The method of claim 22, whereinthe at least two window system resources allocated in (b) furthercomprise: the memory of one or more controllers on the window network.24. The method claim 22, wherein the at least two window systemresources allocated in (b) further comprise: the at least part of thewindow network.
 25. The method of claim 14, wherein the window systemresources allocated in (b) are connected to other window systemsresources by a window network.
 26. The method of claim 14, wherein thewindow system resources selected in (a) comprise a touch sensitiveinterface.
 27. The personal computing unit of claim 14, whereinconfiguring the window system resources allocated in (b) comprisesconfiguring the use of multiple physical memories or storage devices forthe personal computing unit.
 28. The method of claim 14, whereinconfiguring the window system resources allocated in (b) comprisesconfiguring the use of multiple processors for the personal computingunit.
 29. The method of claim 14, further comprising temporarilyproviding an operating system for running on the personal computingunit.
 30. The method of claim 14, further comprising providing thepersonal computing unit with access to one or more softwareapplications.
 31. The method of claim 14, further comprising providingthe personal computing unit with access to one or more internet sites.